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IM'HOIH  (  TION 

I  hr  Vir  Furir  Human  Resource-  l.ahoralorx  (  VI  IIRI  ).  Brooks  \ T It.  lexas.  was  established  in  IBIdf 
a>  an  Vir  force  Sxsteins  t  ommaiid  (\t  S( ,)  lahoralorx.  (During  a  lit-  earlx  pari  of  I'MiB.  il  was  pari  ol  I  In- 
Verospace  Medical  Division.) 

I’ll i -  l.ahoraloi  \  i-  i  1 1 .1  r*i<  < I  wiili  1 1 1  < -  planning  an<l  execution  ol  Vir  l  ou  r  cxploratnrx  anil  advanced 
development  program'  lor  'election.  iiintix aiioo.  training.  rrlrnlion.  education.  assignment.  iilili/alion. 
anil  career  development  ol  mihinrx  pei'onnel:  al-o  llir  cnmpo'ilinu  ol  ilir  pcr-ouucl  Ion  r  anil  training 
oipiipinrni.  I  In-  I  aiioraiorx  aNn  provide-  in  linn  al  anil  management  a-si-lancc  lo  'iippori  -1  tail ii 
analx-e-.  development  planning  aclivilic-.  acipiisiliou.  ir-i  evaluation.  iiindif  iculinu.  ami  opr  ra  I II 1 1 1  ol 
. irnop. 11  r  -  v  —  1 « •  1 1 1  *■  ami  rolaloil  oipiipmonl. 

\l  tin-  onil  of  I'fT'J.  VHIKI.  oon sistoil  of  a  lioadipiarlors  anil  two  divisions  al  Brooks  MB  and  Iwo 
gengraphieallx  disporsod  divisions  as  follows: 

I.  Manpowor  and  I’orsonnol  Division.  and  Technical  Sorvioos  Division.  Brooks  MB.  IVvas. 

Logistics  and  Toolinioal  Training  Division.  W  right-l’attcrson  AKB.  Ohio. 

a.  Logistics  Research  Branch.  Vt  righl-Patlerson  M  B.  Ohio. 

I).  Toolinioal  Training  llram  li.  Lowrv  VLB.  Colorado. 

H.  Operations  Training  Division.  Vi  illianis  VLB.  Vri/ona. 

Mist  rail  onlrios  list  I  ho  division  name  al  the  lime  of  report  publication. 

The  abstracts  appear  in  leelinieal  report  nnmlior  sequence.  Lnlries  following  the  author  and  title 
heading  give  informalioii  iilonlifx ing  the  report  and  indicate  where  il  is  axailahle. 

1‘rojeet  numher:  Besoareh  areas  identified  bv  these  numhers  are  given  in  the  I’ROJH  .l  index.  I  lie 
\ir  Force  roll  I  rail  nninher  and  (he  name  id  the  contracting  organization  are  entered  lor  eoiilrael- 
proihieed  reports. 

DIM  arre-'ioned  doeiimenl  (MB  uiiiuher  indiraie-  axailahililx  to  t.nxerumenl  office-  ami 
registered  1  oulrai  lor-  I  nun  the  Deleii'e  l  ei  h meal  Inlormalioii  t  enter:  tin-  numher  should  heu-eil  xxlien 
reipiesting  report'  |rom  DIM  . 

N  I  IS  appears  oulv  if  the  report  has  hern  deposited  xxilh  the  National  Technical  Inlormalioii  Serx  ire. 
Springfield.  Virginia.  221  al.  for  sale  to  the  general  public. 

To  ohlain  copies  of  reports  without  DIM  i  accessioned  document  (MB  numhers.  I  urnisli  the  names  ol 
authors,  titles,  report  numhers.  and  dales  to  D  I  M  or  \  I  IS. 

This  hihliographx  contains  six  indexes:  I’LRSONM,  M  THOR.  t  !IV II. I VN  ( f  IRI’I  III  \  I  f.  M  IIIOR. 
riKIJITf.  TITI.L.  DIVISION,  and  KKMMHID.  Reports  are  identified  in  the  indexes  hx  the  serial 
numher  appearing  in  (he  lelt  margin  ol  the  abstract  entries,  l  itis  report  does  not  contain  classified  or  lor 
Official  I  '<•  Onlx  leelinieal  report'. 


I  Barlow.  E.M.  Annotated  bibliography  of  the  Air  Force  Human  Resources  Laboratory  technical 
reports  —  1977.  AFHRL-TR-79-1,  AU-A068  143.  Brooks  AFB,  TX:  Headquarters  Air  Force 
Human  Resources  Laboratory.  February  1979.  (Covers  all  AFHRL  projects.)  NT1S.  Phis 
annotated  bibliography  presents  a  listing  of  technical  reports  (1977)  dealing  with  personnel  and 
training  research  conducted  by  the  Air  Force  Human  Resources  Laboratory  (AFHRL). 

The  research  has  been  conducted  by  professional  personnel  representing  a  variety  of  disciplines, 
including  psychologists,  operations  research  specialists,  mathematicians,  computer  analysts, 
economists,  electronic  engineers,  aeronautical  engineers,  and  technical  support  personnel. 

AFHRI.  is  charged  with  the  planning  and  execution  of  I'SAF  exploratory  and  advanced 
development  programs  for  selection,  motivation,  training,  retention,  education,  assignment, 
utilization,  and  career  development  of  military  personnel:  also  the  composition  of  the  personnel 
force  and  training  equipment.  This  Laboratory  also  provides  technical  and  management  assistance 
to  support  studies,  analyses,  development  planning  activities,  acquisition,  lest  evaluation, 
modification,  and  operation  of  aerospace  systems  and  related  equipment.  (56  pages) 


2  Stenger,  T„  Duugan.  W  .  Reynolds.  R.  Computer  image  generation  texture  study.  AFHRL- 
LR-79-2,  AD-A074  019.  Wright -Patterson  AFB.  OH:  Advanced  Systems  Division.  August 
1979.  Project  6114.  Contract  F3361 5-77-C-0063,  Technology  Service  Corporation.  NTIS. 
Ibis  developmental  project  resulted  from  the  need  to  enhance  visual  flight  simulators  (based  on 
computer  image  generation  (CIO)  techniques)  with  textured  surfaces.  Pilots  viewing  homogeneous 
surfaces  experience  an  inadequate  perception  of  motion  above  these  surfaces  as  well  as  an 
ambiguity  in  the  orientation  of  the  surface.  Therefore,  it  was  felt  that  by  using  textured  surfaces 
within  the  scene,  both  depth  an.)  motion  cues  would  be  made  available.  This  report  describes  the 
approaches  and  techniques  used  o  develop  texture  material  and  introduce  it  into  a  complex  tilt, 
scene. 

The  approach  is  to  create  texture  tile  arrays  ot  trees  and  grass  from  digitized  photographs  of  natural 
texture.  These  arrays  are  then  replicated  over  the  surface  in  the  fashion  of  tiles.  Preprocessing 
techniques  are  described  which  eliminate  the  periodic  effect  due  to  the  tile  boundary  and 
macropatterns  within  the  tile  itself.  I.evel-of-detail  texture  tile  arrays  arc  created  that  match  the 
resolution  of  the  texture  to  the  appropriate  observer-scene  viewing  geometry. 

The  lovel-of-detai!  arrays  and  other  descriptive  parameters  are  merged  into  the  existing  CIO 
software  to  produce  textured  images.  Scenes  depicting  a  landing  sequence,  a  divebomb.  and  a  low- 
altitude  flight  were  then  generated.  These  images  show  the  effect  of  the  varying  levels  of  detail, 
fields  of  view,  viewing  geometries,  and  scene  contents  on  the  textured  scene.  The  texture  tile 
tec  hnique  and  subsequent  image-  generation  show  the  feasibility  of  deriving  distance  and  motion 
cues  from  the  additional  information  contained  in  the  textured  images.  (72  pages) 


A  Kelly.  \1.J..  Wooldridge,  1...  Hcnnessy.  H.T..  Vreuls,  I)..  Barnebey.  S.F..  Colton.  J.C.,  th  Reed. 
J.C.  Air  combat  maneuvering  performance  measurement.  AFHRL-TR-79-3,  AD-A077  429. 
Williams  AFB.  AZ:  Flying  Training  Division.  September  1979.  Project  1123.  Contract 
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FX{6lli-77-(MKt79.  Canyon  Research  Croup.  incorporated.  NTIS.  A  studv  was  conducted  in 
define  measures  of  Air  Combat  Maneuvering  (ACM)  for  one-vcrsus-onc  (Ivl)  free  engagements  oil 
the  Siniidalor  lor  Vir-lo-  \ir  Combat  (SAAC).  Tin-  study  found  a  small  set  of  measures  which  were 
(a)  sensitive  to  dillerenees  in  pilot  Vt  A1  skill  level,  (h)  diagnostie.of  perlormaiiee  profieieueies  and 
deficiencies,  (c)  iisahle  h\  inslriielor  pilots  and  eompalihle  with  their  jiid(£iiit*nls.  (d)  capable  of 
providing  results  immediately  after  the  end  of  the  engagement.  and  (e)  eompalihle  with  current 
projected  training  and  measurement  hardware. 

Ihe  study  was  conducted  in  three  phases:  Phase  I  was  an  atialvlical  studv  of  VCM  tasks  using 
information  from  training  material  and  instructor  pilots:  28  measures  reflected  subject  matter 
experts  opinion  on  the  important  elements  of  VCM.  Pilot  control,  aircraft  performance  and 
engagement  outcome  variables  were  measured  in  Phase  2  during  105  free  engagements  on  the  S  \  \< ; 
at  I  .tike  \Hf  using  a  total  id  dll  pilots  with  three  dii  lerent  levels  o!  experience.  \  computer  analv  sis 
ol  the  engagement  data  was  conducted  in  Phase  8  to  (a)  check  methodological  assumptions  that  the 
three  pilot  experience  levels  represented  different  VCM  skill  levels  and  (b)  develop  tile  smallest 
comprehensive  measure  set. 

Out  ol  the  original  28  measures.  Id  were  found  to  discriminate  between  high  and  low  skilled  pilots. 
These  measures,  when  propcrlx  weighted,  could  he  added  together  to  form  a  single  metric  of  VCM 
perlormaiiee  which  accounted  for  I "u  of  the  variance  in  the  free  engagement  performance  data  and 
predicted  membership  in  high  or  low  skill  groups  with  *>2"<.  accuracv.  V  method  to  further  improve 
the  measurement  model  accuracv  was  suggested.  As  a  consequence  of  these  results,  further 
development  ol  diagnostic  measurement,  cross-validation  ol  these  results,  further  development  of 
diagnostic  measurement,  cross-validation  of  the  studv  results,  and  implementation  of  the 
measurement  model  for  developmental  testing  and  ultimate  training  use  on  the  SAAC  were 
recommended.  (I  12  pages) 


Titswortb.  H.I..  Differences  between  crosstrainees  and  non-ernsslrainees  on  grade  level,  job 
satisfaction,  and  assignment  characteristics.  AFHRI.-TR-79- 1,  AD-A069  587.  Brooks  AFB. 
T\:  Occupation  and  Manpower  Research  Division.  Mav  1979.  Project  7731.  NTIS.  This  studv  is 
an  ellorl  to  idenlilv  the  effects  of  crosslraining  which  might  have  implications  for  improving  the 
management  of  Vir  Force  personnel.  Data  on  7.980  crosstrainees  and  1  .’>.083  nou-crosstrainccs 
working  in  3.>  different  Vir  Force  specialties  were  analyzed  to  detect  differences  between  these 
groups  with  regard  to  seven  criteria.  Subjects  were  enlisted  personnel  with  from  I  to  20  vears  of 
service  who  responded  to  Vir  Force  job  surveys  during  the  period  1007  through  I07f.  Multiple 
regression  analv ses  were  used  which  controlled  for  possible  curvilinear  relationships  between  tin- 
criteria  and  lenglh-of-service.  In  108  (8I"«)  of  2 to  crilerion-hv -speciallv  analyses,  tin-  regression 
curves  appropriate  for  erosslrainees  and  non-crosstrainees  were  not  significantly  different  at  the  .01 
level.  In  31  analyses  where  the  groups  differed  signifieantlv  with  regard  to  either  grade,  number  of 
tasks  performed,  job  difficullv.  or  number  ol  subordinates,  ihe  mm-crosstraiucc  group 
predominalelv  had  higher  expected  values.  With  regard  to  the  If)  significant  differences  on  job 
satisfaction  criteria  (reeidistment  intent,  job  interest,  and  fell  utilization  of  talents  and  training),  no 
consistent  pattern  favoring  either  crosstrainees  or  non-crosstrainecs  was  observed.  Implications  of 
the  results  are  discussed.  (20  pages) 


DeLeo,  P.J.,  &  Slaughter.  S.L.  Measuring  student  altitudes  toward  the  Air  Force  Traffic  Safely 
Course.  AFHRL-TR-79-5,  AD-A071  108.  l-owry  AFB,  (X):  Technical  Training  Division.  May 
1979.  Project  l  SAS.  NTIS.  V  questionnaire  survey  was  developed  to  measure  the  altitudes  of 


students  toward  the  Air  Force  Traffic  Safety  Course.  Mandatory  for  virtually  all  personnel  entering 
the  Air  Force,  this  course  was  being  taught  in  a  standardized  multimedia  format  at  more  than  I  10 
locations  throughout  the  world.  It  was  a  10  hour  course  of  instruction  covering  environmental 
hazards,  vehicle  control,  emergency  situations,  etc.  Dimensions  measured  by  the  questionnaire 
included  attitudes  toward  instructor,  course,  and  media  effectiveness  and  opinions  about  various 
environmental  features  such  as  noise  and  temperature.  Attitudes  were  measured  both  at  unit  level 
and  to  the  course  as  a  whole.  Reliability  was  found  to  be  acceptable.  Results  of  a  validation  study  are 
presented.  It  was  recommended  that  the  questionnaire  be  adopted  for  use  and  suggestions  were 
made  for  data  analysis  procedures.  (28  pages) 

6  kottenstette,  J.P.  Microfiche  applieations  in  an  individualized,  self-paced  learning  system. 
AFHRL-TR-79-6,  AD-A069  445.  Lowry  AFB.  CO:  Technical  Training  Division,  Mav  1979. 
Project  1121.  Contract  F5H6 1 5-77-C-0057,  l  niversilv  of  Denver.  INTIS.  The  microfiche 
medium  offers  proven  advantages  in  the  management,  storage,  and  retrieval  of  information,  as  well 
as  significant  cost  advantages.  The  study  was  directed  towards  developing  microfiche  formatting 
concepts  and  microfiche  production  methods  to  capture  the  power  of  the  medium  for  delivery  of 
both  text  and  illustrations  within  context  ot  the  Advanced  Instructional  System  (AIS) —  a  computer 
based,  multi-media,  self-paced  instructional  program  of  the  Air  Training  Command  at  Lowry  AFB. 
Colorado.  Specific  applications  were  (a)  the  conversion  of  color  intensive  audiovisual  modules  to 
microfiche:  ( h)  the  formatting  ol  the  microfiche  to  deliver  both  primary  and  alternative  track 
modules  in  an  integrated  "multi-track"  module,  and  (c)  the  use  of  microfiche  in  testing  and  test 
control.  A  primary  consideration  yvas  the  investigation  of  computer  output  microfiche  (COM) 
technology  as  a  means  of  authoring,  revising,  and  managing  instructional  materials.  A  microfiche 
system  was  designed,  utilizing  existing  AIS  computer  resources,  which  satisfied  admiustrative  as 
well  as  instructional  requirements.  The  system  is  called  the  dual-fiche  concept  and  provides  a  way  to 
separate  the  production  of  the  text  component  of  an  instructional  module  from  the  production  of  the 
graphics  component,  combining  the  two  types  of  information  at  the  point  of  use  —  the  microfiche 
reader.  This  development  brings  the  power  ol  ( iOM  to  bear  directly  on  the  problems  of  updating  and 
revising  instructional  materials  while  gaining  the  flexibility  necessary  to  produce  graphics 
(particularly  color-intensive  graphics)  consistent  with  content  formatting  requirements.  The 
concept  involves  two  transparencies  (one  with  text  and  the  other  with  graphics)  which  are  projected 
simultaneously . 

Appt  nations  were  then  developed  in  which  specific  AIS  lessons  were  formatted  for  multi-track, 
color  intensive  presentation  on  microfiche.  In  addition,  block  tests  were  produced  also  using  (!0M 
production  techniques.  Classroom  trials  were  conducted  and  the  microfiche  systems  were  evaluated. 

The  Dual-Fiehe  concept  charts  a  path  that  promises  to  be  a  cost-effective  alternative  to  existing  AIS 
instructional  media  and  promises  the  additional  benefit  of  routine  update  and  revision  of 
instructional  modules  that  combine  text  and  graphics.  (18  pages) 

7  Pierce,  B.J..  De  Maio,  J„  Eddowes,  E.E.,  &  Yates.  D.  Airborne  performance  measurement 
methodology  application  and  validation:  F-4  pop-up  training  evaluation.  AFHRL-TR-79-7. 
AD-A072  61 1.  Williams  AFB,  AZ:  Fly  ing  Training  Division,  June  1979.  Project  1 123.  NTIS.  A 
methodology  was  developed  to  evaluate  pilot  performance  on  the  pop-up  weapon  delivery. 
Instructor  pilot  ratings  were  used  to  measure  performance  on  the  critical  stages  of  the  maneuver. 
Validity  of  the  methodology  was  assessed  using  21  pilots  assigned  to  an  F-t  training  squadron. 
Results  indicate  that  instructor  pilot  ratings  of  individual  stages  of  the  delivery  yield  a  reliable  index 
of  the  quality  of  performance  on  the  maneuver.  The  individual  stage  performance  ratings  identified 
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•  he  proficiency  levels  attained  on  certain  flying  skill  areas  critical  to  mission  readiness.  This 
information  enabled  an  examination  of  the  relationship  between  pilot  learning  and  training 
program  design.  (20  pages) 

H  Thomson.  D.O.,  A  t.oodx,  K.  Three  sets  of  task  factor  benchmark  scales  for  training  priority 
analysis.  \FHRI.-TR-79-8.  AD-A072  167.  Brooks  AFB.  T\:  Oeeupalion  and  Manpower 
Research  Division.  May  1070.  Project  773f.  NT1S.  The  Occupation  and  Manpower  Research 
Divi-mn  ul  the  \ir  f  orce  lliun.ui  Resources  Laboratory  has  established  that  task  training  priority  is 
a  function  ul  la-k  factors  and  that,  within  a  'pecialtv.  training  prioritv  ratings  can  lie  duplicated 
ma'beinalicaflv  from  task  factor  ratings,  because  these  ratings  are  measured  on  a  dillerenl  scale  lor 
each  spcciallv.  lhi»  mclhodologv  cannot  be  generallv  established  and  applied.  To  overcome  this 
limitation,  a  series  of  benchmark  scales  wa-  developed  lor  the  measurement  of  task  factors  against 
common  Ironies  ul  reference.  Ibis  report  presents  the  development  nl  the  benchmark  scales  lor 
specialties  with  an  electronn  and  a  mechanical  aptitude  requirement.  It  then  reports  on  the 
validation  of  the  three  sel~  ul  benchmark  scales  ( Xdminislrativc/licucral.  Klecfronie.  and 
Mechanical  I.  The  benchmark  scale-  were  -bow  ii  to  have  advantages  and  disadvantages  compared 
with  the  traditional  relative  -rale-.  (  Iti  page-) 

'I  l.ammlein,  S.K..  &  Borman,  tt.f..  Peer  rating  research:  Annotated  bibliography.  AF'HRL-TR- 
79-9,  AD-A07I  KI9.  Brooks  AFB.  TX:  Personnel  Research  Division.  June  1979.  Project  77  J 9. 
(.on tract  Kl.'lfil.i-78-(.-(H)fl,  Personnel  Derisions  Research  Institute.  NT1S.  This  report  is  an 
annotated  bibliography  of  peer  rating  research.  Personnel,  industrial,  and  social  psychologv 
journals  and  technical  reports  were  reviewed  to  identify  studies  emploving  peer  ratings,  and 
annotations  ol  these  studies  were  prepared.  In  our  view,  the  most  noteworthy  findings  from  this 
literature  are  the  following: 

1.  Peer  ratings  on  personality  traits  consistently  yield  similar  factor  structures,  suggesting  that  the 
dimensionality  ol  these  ratings  may  reflect  raters’  commonlv  held  beliefs  about  personality. 

2.  Peer  ratings  typically  show  high  interrater  agreement,  especially  when  the  stability  of  these 
ratings  is  enhanced  by  gathering  evaluations  from  many  peers. 

Peer  ratings  often  correlate  only  moderately  with  ratings  from  other  sources  (e.g..  supervisors). 
Presumably,  such  disagreements  in  ratings  arise  because  members  of  different  organisational  levels 
have  different  perspectives  on  what  it  lakes  to  perform  effectively  ,  and  these  groups  tvpicallv  view 
different  samples  of  ratees’  performance-related  behavior. 

f.  Peer  ratings  often  provide  good  predictions  of  subsequent  performance  in  training  or  on  jobs. 

I  hi-  result  has  been  most  consistently  obtained  in  military  settings,  but  peer  ratings  in  industry 
have  also  proven  to  be  good  indicators  ol  future  performance.  Such  successes  have  been  attributed 
to  peers  comparatively  good  opportunity  to  observe  ralee  behavior  relevant  to  assessing 
performance  effectiveness.  (  V<>  pages) 

10  Hendrix.  W  .11..  A  Halverson.  \  .B,  Situational  factor  identification  in  Air  Force  organizations. 
AF HRI.-TR-79- 10.  AD- A0(>8  823.  Brooks  AFB.  T\:  Oeeupalion  and  Manpower  Research 
Division.  May  1979.  Project  2313.  NTIS.  Research  dismissed  in  this  report  focused  on  factor 
analyzing  the  Job  Inventory  of  the  Organizational  \ssessmeiit  Package  (OXP)  to  isolate  the  factors 
associated  with  a  manager's  situational  environment.  Nine  factors  were  extracted  and  orthogonally 
rotated  to  simple  structure.  F.aeh  factor's  internal  consistency  index  was  computed.  The  utility  of  the 
Job  Inventory  as  an  organizational  diagnostic  instrument  is  discussed.  (20  pages) 


I  Mullins.  C.J..  Karles,  J.A..  &  ilbmirn.  J.M.  Personnel  ruling  fffcclivt'iit'ss  as  a  function  ni 
number  of  rating  statements.  AFHRL-TR-79- 1  I.  AI)-A(IM  436.  Brooks  AFB.  T\:  Personnel 
Research  Division.  Mav  I*)?*).  Project  2'i  I  NTIS.  Previous  work  on  set-  of  personnel  rating 
statements  leave  unanswered  the  i|iicslinn  of  whether  there  is  anv  advantage  in  using  several 
"factor"  rating  statements  over  the  use  of  a  single  statement,  l  itis  is  a  sludv  of  the  comparative 
ulililv  of  sets  of  rating  statements  varying  in  niimher  ol  statements  per  set.  using  an  external 
criterion. 

A  great  deal  of  research  effort  has  been  expended  in  an  effort  to  find  "hest"  factors  for  collecting 
rating  data.  Most  of  this  research  has  concentrated  on  internal  psychometric  characteristics  of  the 
rating  data,  such  as  means,  standard  deviations,  and  reliability  coefficients.  Vt  hen  internal 
psychometric  considerations  constitute  the  sole  criterion,  some  small  advantage  is  frequently  found 
for  one  kind  of  rating  statements  over  another.  hen  external  criteria  for  evaluating  "goodness"  of 
rating  sets  are  applied,  there  are  usually  no  differences  found  among  sets.  Indeed,  there  have  been 
some  indications  that  raters  generally  may  not  he  able  to  evaluate  ralees  on  more  than  one  general 
quality  of  overall  excellence  and  that  collecting  several  '"factor  ratings  mav  he  little  more  than  time 
wasted. 

The  subjects  for  this  study  were  132  students  at  the  NCO  academy  at  Lackland  AFB.  Three 
treatment  conditions  were  applied.  Of  the  I.f2  subjects.  45  were  required  to  rati1  their  peers  in  their 
15-man  study  groups  on  20  rating  factors.  Another  14  subjects  rated  their  peers  on  10  factors,  which 
were  a  subset  of  the  20  factors  used  by  the  first  group.  Still  another  43  subjects  rated  their  peers  on  a 
subset  of  only  five  rating  factors.  From  the  ratings,  profiles  were  developed  for  each  subject 
indicating  how  that  individual  had  been  rated  by  a  peer  group.  These  profiles,  with  no  identifying 
information  on  them,  were  handed  out  to  the  group  members,  who  were  required  to  identify  them. 
A  record  was  kept  of  all  correct  identifications.  Analyses  of  v  ariance  were  done  to  see  if  there  were 
any  significant  differences  among  the  three  groups.  In  addition,  correlation  coefficients  were 
computed  between  the  various  sets  of  rating  statements  and  a  criterion  of  class  standing  upon 
graduation,  to  see  whether  20  statements  predicted  this  criterion  better  than  10  anil  whether  10 
statements  were  more  predictive  than  five. 

The  analy  sis  of  variance  portion  of  the  study  produced  no  significant  differences  among  the  groups. 
The  multiple  linear  regression  analyses  indicated  that,  when  only  two  of  the  statements  were  used  as 
predictors,  addition  of  the  other  18  to  the  predictor  pool  generated  no  useful  additional  prediction. 
The  results  of  this  study  indicate  that  a  very  small  set  of  rating  factors  (e.g..  two  in  this  study) 
produce  information  about  a  ratee  which  cannot  be  improved  hv  the  addition  of  many  more  factor 
statements.  (18  pages) 

!  Montgomery.  A. I)..  &  Judd,  ^  .A.  Computer-assisted  instruction  in  the  context  of  the  advanced 
instructional  system:  Authoring  support  software.  AFHRL-TR-79- 1 2.  AD-A08I  071.  Lowry 
AFB,  CO:  Technical  Training  Division,  December  1079.  Project  1 121.  Contract  F33615-78-C- 
0022.  McDonnell  Douglas  Astronautics  Company— St.  Louis.  NTIS.  This  report  details  the 
design,  development  and  implementation  of  computer  software  to  support  the  cost-effective 
production  of  ( .omputcr-  \ssisted  Instruction  (( .  \1)  w  ithin  tin*  context  ol  the  \dvanccd  Instructional 
System  ( A  IS)  located  at  Lowry  \HL  Ibis  report  supplements  the  computer  managed  \ir  Force 
technical  training  that  is  currently  supported  by  AIS.  giving  the  Air  Force  a  full  function  Computer 
Based  instructional  system.  The  interactive  Vuthoring  Kdilor.  Presentation  Program.  Data 
Collection  and  Data  Print  software  components  of  the  CAI  system  are  detailed.  The  Kdilor 
simplifies  the  authoring  task  by  (a)  eliminating  the  need  for  the  author  to  use  a  computer  language, 
(b)  structuring  the  task,  (c)  providing  computer  aided  input,  and  (d)  extensive  formatting  and 
editing  capabilities,  f  he  software  also  provides  conditional  and  unconditional  branching  (hat  can  he 
specified  from  the  Kdilor.  (8<>  pages) 
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<  icohim-Hi.  1..F.  Avionics  maintenance  training:  Relative  effectiveness  of  68H3  simulator  and 
actual  c«|ui|iuicnl  —  test  and  evaluation  plan.  AFHRL-TR-7*>- 1 3,  AD-077  .‘112.  Lover*  AFB.  (!(): 
Technical  Training  Division.  October  l')7‘).  Project  23(>l,  (outran  F33ftl3-78-(!-(M)18. 
I  niversilv  of  Denver.  \  I  IS.  (airrenllv  there  are  iiisullieient  empirical  data  to  assist  informed 
decision-making  regarding  the  condition'  of  'iimdalor  effectiveness  in  test  station  mainlenanee 
training.  I  lie  purpose  ol  this  interim  report  is  to  document  the  implementation  of  a  detailed  test  and 
cost-evaluation  plait  currcntlv  ctnplovcd  in  the  32(>\  training  field.  I  he  ohje<  lives  ol  this  plan  are  to 
obtain  quantitative  and  qualitative  data  lor  eomparativ elv  evaluating  simulator  and  at  Inal  test 
equipment  on  dimensions  of  (a)  instructional  elleetiveness  (h)  time-savings  (c)  life  cvcle  cost 
elements  hi)  altitudinal  acceptance  and  (c)  subsequent  field  performance.  Lost-benefit  scenarios 
t it v til v  i nj»  variation  in  parameter  value-,  e.g..  student  llovv.  aptitude  level-,  course  Icuglb  and 
specilie  hie  cvcle  cost  dement  data  will  permit  analv-l-  to  make  more  objective  determinalion- 
concerning  the  el  lecliv  ene-s  and  ellieiencv  ol  -imulator-  compared  to  actual  equipment  given 
dillerent  -itunlioiis.  (till  page-) 

Dobrovoluv.  .1.1...  MeLombs.  ILL..  X  Judd.  W  .  A.  Orientalioii/time  management  skill  training 
lesson:  Development  and  evaluation.  \FHRI.-TR-7‘>- 1  I.  AD-A07I  020.  Low  rv  AFIL  TO: 
leehnical  Training  Division.  July  I  *)7*).  Project  1121.  ((outran  MDA-003-77-0 1  I  1. 
MeDouiiell  Douglas  Astronautics  (  ompauv — St.  Louis.  N  I  IS.  Materials  contained  within  llti- 
reporl  are  designed  to  as-i-l  -Indents  in  their  adaptation  to  the  novelties  ol  a  computer-assisted 
or  -managed  instructional  environment  Ihi-  <  hienlalioii/ Fitne  Management  lesson  provide- 
-litdenl-  with  appropriate  role  model-  lor  increasing  acceplanee  ol  their  increased  re-pon-ibililv  lor 
learning  and.  it  introduces  a  progress  tracking  approach  to  a— i-l  students  in  ai  Itiev  ing  completion 
goal-  in  a  -ell-paced  training  environment.  I  valuation  data  from  an  implementation  of  tlie-e 
material-  ill  tile  \ir  Force  \dv  alli  ed  lii-lructional  >v  stem  I  MS)  -ugge.i  that  substantial  time  -av  ing- 
ean  he  obtained  In  a  combination  ol  till-  Ivpe  ol  orientation  and  time  management  skill  training 
with  a  eompnler-ha-ed  progre—  targeting  and  leedhack  -v-leni  (on  the  order  ol  *)  to  Iff  percent 
reduction  in  cotir-e  completion  lime-1.  (I  Iti  page-) 

Moore.  S.B..  Madison.  \\  .(...  Sepp.  (..I)..  Straeeuer.  .1.1..  X  toward.  B.K.  Air  combat  training: 
t.ood  slick  index  validation.  \FMBL-  IB-7*)- 1 3.  AD-A07I  (l.'f.'f.  Williams  AFB.  A/:  Flying 
(raining  Division.  June  l')7').  Project  1123.  Lontracl  F3  1 60  I  -  77- A-0  I  76.  Nought 
(  nrporul  ion.  N  ITS.  I  lie  Loud  Suck  Index  validation -tudv  -tali-ticallv  investigated  an  empiricallv 
derived  mea-ure  ol  pilot  prolu  tencv  m  an  air  combat  simulator.  Statistical  methods,  including 

regres-ion  and  discriminant  anal  v  -es.  were  u-eil  to  ev  a  I  mile  LSI  -cores  a-  predictors  ol  -Indent  I  . . 

engagement  performance-  in  the  T  \<  \(  l\>  I  -imulator  training  program.  Slalislii  allv  derived 

perlormaitce  predictor-  are  obtained  I  rout  objectivelv  mea-ured  parameters  recorded  during 
-imulator  training.  I  he  elici  t  ol  tuclii'inii  ol  -tudeul  pilot  demographic  data  with  the  objective  data 
i-  inv e-ligated.  I  diiiuetric  .md  p-vchometric  data  are  presented  a-  indicators  ol  -kill  development. 

Ife-ull-  ol  the  -tudv  v  ield  performance  predictor-  for  lour  groupings  vv  it  It  i  it  each  I  \(  \<  IS  I  chls-: 

(a)  winner-,  (h)  winner- or  riinner--up.  (e)  upper-hall  winners,  and  (d)  student  qttarlile  ranking. 
I  lie  empiricallv  derived  mea-ure  -how-  a  prohahilitv  ol  winner  prediction  ol  23  percent,  whereas 
the  -luli-lirallx  derived  optimal  mea-ure  -how  -  a  prnhahilil*  of  winner  prediction  ol  Hi)  percent.  I  lie 
reliahiliiv  ol  the  performance  predictor-  i-  a-'Cs-od.  Potential  ulili/alion  and  limitations  ol  the  t.ood 
>lnk  Index  are  addre--ed.  (loft  page-) 


16  McF'arlanc,  T..  kaiitor.  J.K.,  &  Cuinn.  N.  Correlates  of  successful  on-the-job  performance  in 
lilt*  Srrurilt  Pulin'  (Air  Force  Specially  (axle  8IXW)  career  field.  AFIIRI.-TR  -76- 1 6,  AD- 
A072  167.  Brooks  AFB,  TX:  Personnel  Beseareli  Division.  June  1676.  I'rojee!  7716.  NTIS.  V 
Seeurilv  Test  Ballerv.  lapping  pre-training  hiographie/dcmograpliic  factors  and  pn«f-fraiuiug  joh 
exiterienee  tai  lors,  was  administered  in  the  field  lo  .1.1  To  Seeurilv  Police  (81XXX)  personnel.  Joli 
performance  ratings  were  simultaneously  collected  on  these  personnel  from  their  lirst-line 
snperv isors.  I  sing  multiple  linear  regression  analyses,  it  was  found  that  2 1  pre-training  factors  were 
significanllv  related  lo  joh  performance.  It  was  possible  lo  categorize  these  specific  items  into  lour 
major  areas:  age.  attitudes  toward  parents  and  former  teachers,  family  s  socio-economic  status,  and 
aspects  of  the  individual's  personal  lifestyle.  From  the  post-training  joh  experience  factors.  II 
significant  correlates  of  joh  perlormanee  were  lound  which  could  also  he  grouped  into  lour 
altitudinal  areas:  toward  supervisors,  the  Air  lone  in  general,  environmental  factors,  and  co- 
workers.  ( Iross-applicalion  of  these  results  indicated  reasonable  generalizahililv .  I  he  potential 
effects  of  manipulating  these  variables  through  selection,  classification,  ami  management  are 
discussed.  (12  pages) 


17  Woodruff,  R.R.  Effects  of  varying  visual  display  characteristics  of  the  T-  M,,  a  T-37  flight  simulator. 
AFHRL-TR-76-17,  AD-A071  410.  Williams  AFB,  AZ:  Flying  Training  Division.  June  1676.  Project 
1 123.  NTIS.  Two  experiments  were  conducted  using  the  T-40.  a  T-37  flight  simulator,  lo  investigate 
the  benefit  to  simulation  of  visual  displays  which  have  color  or  are  collimated.  Thirty-two  Air  Force 
undergraduate  pilots  learned  approach  and  landing  in  the  T-40  using  either  black  and  white  or 
colored  imagery.  Thirty-eight  instructor  pilots  performed  approach  and  landing  with  visual  displays 
that  had  collimation  or  reduced  collimation.  No  statistically  significant  differences  were  found  in 
either  experiment.  Power  analysis  shows  that  each  of  these  experiments  would  have  detected  a 
practically  significant  difference,  if  one  existed,  with  a  probability  of  more  than  .7.').  There  are  no 
psvchophvsical  reasons  to  use  either  color  or  collimation.  I  ser  acceptance  is  another  thing,  and  if 
color  and  collimation  improve  acceptance,  they  should  be  used.  (18  pages) 


18  Servers,  J.A.,  &  Makinney,  R.L.  Simulator  for  air-to-air  combat  motion  system  investigation. 
AF'HRL-TR-76-18,  AD-A072  612.  Wiliams  AF'B,  AZ:  F'lving  Training  Division.  July  1676. 
Project  1123.  NTIS.  This  investigation  as  conducted  to  evaluate  the  Simulator  for  Air-lo-Air 
Combat  (SAAC)  motion  system  response  Ic  .nown  input  signals,  to  observe  platform  movements,  to 
measure  leg  extension  velocities  and  aecrl.  aliens,  and  to  establish  delay  lags  through  the  system 
electronics  and  hydraulics.  Signal  voltages  a  arc-established  levels  were  input  by  a  signal  generator 
at  the  analog-to-digital  converter  simulating  pilot's  control  stick  movements.  Resulting  platform 
movement  was  recorded  on  strip  chart  recorder  measuring  accelerations  and  final  positioning  from 
six  linear  and  angular  accelerometers  mounted  beneath  the  motion  platform.  Several  noticeable 
factors  were  revealed  that  contribute  to  the  status  of  the  motion  platform  being  less  than 
representative  of  motion  of  the  aircraft.  First,  the  motion  platform  lags  the  input  command  by  a 
noticeable  amount.  The  platform's  motion  is  about  a  multiple  set  of  axes  rather  than  a  single  axis  as 
the  command  would  direct.  Also,  because  of  physical  constraints  on  the  size  of  the  system,  the 
magnitude  and  deviation  of  the  motion  are  limited.  A  fourth  major  problem  is  that  when  the 
excursion  is  near  the  maximum  allowable,  the  motion  is  stopped  too  abruptly,  and  this  stopping  is 
readily  perceived  by  the  pilot  (the  washout  problem).  (22  pages) 

16  Condon.  C.F.M.,  Ames.  U...  Ilrnnrssy.  J.K..  Shriver,  K.l...  S  Seeman,  H.K.  Flight  simulator 
maintenance  training:  Potential  use  of  state-of-the-art  simulation  techniques.  AF  IIRI.-1  R-76- 
16.  AD-A072  478.  I.owrv  AFB.  CO:  Technical  Training  Division.  June  1676.  Project  2361. 
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(iontract  F.‘Li(»l.»-77-(!-003B.  kiuton.  Incorporated.  NTIS.  A  sludv  was  undertaken  lo  evaluate 
I  lit-  potential  application  of  state-of-the-art  >i  m  ulal  ion  teehuologv  lo  the  area  ol  maintenance 
■  raining.  The  vehicle  of  I  lit-  sludv  ua>  I  ho  .ill\\  career  field.  w  liicli  is  concerned  with  the 
maintenance  of  digital  flight  simulators.  Vn  analv-is  was  performed  on  the  tv pes  of  maintenance 
tasks.  espeeiallv  troubleshooting  tasks.  performed  In  technicians  in  tin-  Held.  \n  analvsi-  wa>  also 
done  on  the  technical  school  training  for  this  carirr  field.  Two  leelinieal  ><  l n m >1  course-  were  the 
focus  of  si  ml  \  :  Digital  Flight  Simulator  Speeiallv  (WIND  and  I  ligilal  Na\  igation/Taclics  Train  ill): 
Devices  S|ieeiall\  (.fll\<>).  The  results  of  llie  task  aualvsis  anil  training  analv-i-  were  used  in  a 
sludv  lo  determine  the  l\|ies  of  simulation  training  a|i|iroaehes  that  would  lie  most  suitable  lor 
supporting  the  assessed  training  needs.  Three  training  eoueepts  were  de\ eloped  to  support  tile  tv  pes 
of  mainteiianee  skills  and  knowledges  reipiired  in  the  .'f  1 1  \\  eareer  field.  \ir  Force  personnel  then 
seleeled  two  of  these  training  eoueepts  lor  translation  into  prime  item  de\ elopment  speeifiealiou>. 
(.">(1  pages) 


20  Mel  intuits,  It .  I . . .  Dohrovnluv .  J.L.,  &  Judd.  M.A.  (oinpulcr-managcd  inslruetion : 
Development  and  evaluation  of  student  skill  modules  lo  reduce  training  time.  AFIIKL-I  lf-79- 
20.  Al)-A07  I  021.  Lowrv  AFIt.  (X):  Teehnieal  Training  Division.  August  1079.  Project  1121. 
(amlrael  MDA-903-77-01  ff,  McDonnell  Douglas  Astronautics  (iompanv  — St  Louis.  NTIS.  The 
development  and  evaluation  of  the  (All  Student  Skills  Project  are  described  within  the  context  ol 
the  Vir  Force  Vdvaneed  Instructional  Svslcm  (MS).  The  student  skill  modules  developed  were 
designed  as  short  packages  to  he  assigned  near  the  beginning  ol  anv  military  technical  training 
course.  Inti  which  included  strategies  or  procedures  that  would  continue  to  effect  student  behavior 
throughout  the  course  (c.g..  behavioral  sell  control  lechniipies).  following  a  series  ol  student 
interviews  to  determine  the  characteristic  problems  students  encounter  in  a  (All  sv stent,  an 
Orientation  to  (All/Time  Management  Lesson  and  Stud)  Skills  Package  were  developed  and 
implemented.  The  Sludv  Skills  Package  included  a  sell-rating  Student  Sludv  Skills  Oucslionnairc 
and  four  sludv  skills  training  modules  in  the  areas  ol  reading  comprehension,  memori/ation.  lest 
taking,  and  concentration  management  skill-.  \n  Instructor  Orientation  and  Training  Package  was 
also  developed  to  be  used  In  conjunction  with  the  sludv  skills  diagnostic  ami  remedial  materials,  and 
lo  prov  ide  instructors  with  basic  -kills  In  their  new  role  as  facilitator  ol  student  learning.  I.  v  a  Inal  ton 
results  indicated  that  (it)  substantial  lime  savings  can  he  obtained  hv  a  combination  of  (All 
orientation  and  lime  management  -kill  training  with  a  computer-based  progress  targeting  anti 
feed  back  sv  stein  (i.c..  on  the  order  ol  nine  to  I  If  percent  reductions  in  course  complel  ion  limes):  (b) 
consistent  student  training  lime  reductions  and  perlormanee  gains  can  he  obtained  hv  the  use  ol  the 
-ludv  -kill-  materials  for  -Indents  identified  as  deficient  in  particular  sludv  skills  areas:  (c)  the 
Sludv  Skills  (Jucslionnairc  vva-  a  reliable  and  valid  measure  ol  student  skills  in  the  lour  sludv  skills 
areas  and  reliablv  discriminated  students  performing  salistaclorilv  versus  poorlv  in  the  VIS 
technical  training  env  iroument:  and  (tl)  the  Instructor  Orientation  and  Training  contributed  to  the 
efficient  remediation  of  student  sludv  -kill  deficiencies  and  improved  instructor  perceptions  ol  their 
(  All  role  The  results  of  this  project  are  separalelv  described  in  two  sections  ol  (his  report:  an 
f.veoutivo  liepurl  Section  and  a  Scientific  Data  Section.  (If  I  pages) 


21  Hooke.  L.K..  Dcl.cn.  P.J..  A  Slaughter.  S.L.  if  eaduhililv  of  Air  Force  publications:  A  criterion 
referenced  evaluation.  \  I'  II K I.-  I  If  - 1 9-2 1 .  \  D-  A  0  ( .»  2.f  ( .  Low  rv  AF  If.  (X):  Tech  ttieal  Training 
Division.  September  1979.  Project  1121.  NTIS.  The  major  objective  of  this  -ludv  was  to 
investigate  the  readahihlv  ol  a  'ample  ol  \ir  force  regulation-  which  had  been  rewritten  in 
accordance  with  a  recent  Vir  force  directive.  Ifegulaliou  writers  are  directed  lo  match  ill  their  texts 
the  target  reading  grade  level  (Ifl.l.)  ol  the  personnel  who  will  use  the  regulations.  The  directive  also 
specific-  the  method  for 'estimating  lf(.l  s.  In  the  first  part  of  this  sludv.  the  writer— estimated  Iftil. 
lor  each  regulation  wa«  rechecked  hv  Vir  force  Human  Uesnurces  l.aboralorv  staff  using  the 


II 


f'ORCAST  formula.  Il  was  found  that  four  of  I  lie  seven  writers  underestimated  the  ROI,  <d  their 
regulation  h\  more  than  one  grade  level.  None  of  the  writers  was  aide  to  (iroduee  a  doeumen!  with  an 
KOI..  as  estimated  hv  AFIIRI..  mueh  helow  I  1  th  grade,  while  the  audience  ROI.  of  three  of  the  seven 
fields  was  helow  10th  grade.  The  main  |>orlion  of  the  sludv  involved  testing  the  comprchc  tisihililv  ol 
each  regulation  to  its  user  audience  hv  means  ol  the  <1.0/ 1.  procedure.  In  this  testing  method,  everv 
fifth  word  of  a  passage  taken  from  the  regulation  was  deleted,  and  personnel  were  asked  to  lill  in  the 
blanks  with  their  hcsl  estimates  of  the  missing  words.  V  criterion  id  a  (.l.OZf.  score  (Id"") 
corresponding  to  a  7.VV  score  on  a  traditional  comprehension  lest  was  set  as  the  standard  lor 
adetpiate  comprehension.  Mean  scores  in  three  fields  were  clcarlv  above  criterion,  and  the  score  in 
one  additional  field  was  borderline.  I  sing  the  term  lileraev  gap  to  reler  to  a  situation  where  a  text  is 
written  at  an  Rid,  too  high  lor  its  intended  readers,  il  was  found  that  in  all  eases  when  there  was  no 
such  gap.  comprehension  was  adequate.  In  all  these  cases,  however,  audience  KOI.  was  also  quite 
high.  In  three  of  the  four  instances  where  a  lileraev  gap  did  exist,  comprehension  scores  were  helow 
criterion.  In  all  three  of  these  eases.  KOI.  was  low  (below  b.2).  (.'«>  pages) 

Kuiffiu,  .1.1)..  Stevenson.  ('.It..  Mare.  O.K.,  Kiitiu.  K.H..  Slaughter.  S.l...  A  Hooke.  I.. 
<>l  irrational  consequences  of  lileraev  gap.  VI'IIKI.-' TK-7*)-22.  AD-AOR  I  7K2.  I.owrv  Al'  It.  (  .(): 
Technical  Training  Division.  Mav  DMtO.  Project  1121.  Oonlraet  KX'ffi  1 7-77-0-00  HI. 
\\  eslinghousc  Klertrie  Onrporalinn.  VHS.  \ir  l  one  managers  and  supervisor-  often  lace 
problem'  caused  hv  reading  difficulties  among  their  personnel.  These  Usiiallv  appear  to  be  a  joint 
function  of  level  of  reading  'kill  id  the  personnel  and  level  of  dilfirultv  of  the  materials  (hev  lace, 

Idle  term  "lileraev  gap  reler'  to  the  dillrrrnrr  between  the  two  levels.  This  'Inch  pro) . .  lo 

examine  ihr  riled'  upon  reading  comprrhr n-ion  and  preferences  ol  three  sizes  ol  lileraev  gap-. 
Ihi'-lmlv  involved  three  independent  variables:  \ir  I  on  e  personnel  al  lesled  reading  grade  lev  eh 
(KOI.')  ol  It  and  III:  \ir  force  job  related  inaleriah.  written  at  lileraev  gaps  of  0.  -2.  and  -  I.  ami 
reading  lime'  ol  ill.  1.7.  and  (id  minutes.  \  gap  of  -2.  for  example,  meant  that  the  materials  were  two 
grade  level'  higher  than  the  tested  reading  abililv  ol  the  subject'.  \n  additional  question  ol  interest 
vva-  whether  increasing  the  time  allocated  for  reading  would  mitigate  the  effect  ol  large  lileraev 
gap-.  1  lot',  reading  limes  o|  .it I.  17.  and  (ill  minutes  were  examined.  Subjec  ts  were  \ir  force 
per-onnel  al  two  level'  ol  reading  abililv.  dill  and  little  grades,  (onleiil  was  chosen  I  rum  \ir  force 
job-related  material  in  two  areas:  Supcrvi-ion  and  Safe-tv /Sanitation.  Heading  material' consisted  ol 
c2.»lt  word  pas-age'  prepared  at  readahililv  grade  levels  ol  ff.  1(1.  12.  and  I  I.  with  content 
mu  hanged.  Multiple  choice  test'  ol  comprehension  were  also  prepared  and  a  short  questionnaire 
designed  lo  measure  prelerenees  vva'  developed. 

I’relerencc  measure'  indicated  that  reader'  judged  lower-gap  materials  signil icantlv  easier  lo  read 
and  c  learer  than  higher  gap  material'.  When  comprehension  scores  were  analv/ed.  the  result'  were 
a-  follows:  (a)  performance  on  the  Salelv /Sanitation  passage  wa»  'ubslanliallv  heller,  (b)  subjects 
with  Ittlli  grade  reading  abililv  performed  coii'i'lenllv  better  than  those  with  Dili  grade  abililv.  (c) 
greater  lileraev  gap-  b-d  to  poorer  eompreheu'iou.  but  the  elicit  ol  this  variable  vva'  relativelv 
•  mall,  and  (ill  longer  reading  time-  led  to  greater  comprehension.  I lovvev cr.  comprehension  did  not 
im  rcn-c  in  proportion  to  the  amount  ol  additional  reading  lime:  that  i-.  a  large  amount  ol  additional 
lime  invested  in  reading  resulted  in  nnlv  a  mode-l  gain  in  comprehension.  Il  -liotild  he  noted  that 
the-  el  led-,  though  slali-licallv  -iguilieaul.  were  small  and  that  the  largest  el  loci  vva-  due  lo  subject 
matter  rather  than  anv  of  the  variables  of  experimental  interest. 

Ihe  billowing  rccommcudulinu-  lor  the  Vir  force  were  made:  (a)  Indore  major  eflort'  are 
undertaken  lo  rewrite  \ir  f  orce  material-  lor  greater  ease  ol  reading,  il  would  -com  expedient  to 
determine  bow  much  a  negative  lileraev  gap  influence'  actual  job  performance,  -lit  eflorl-  lo 
improve  readahililv  of  materials  -lioulil  be  directed  al  population-  and  situation-  where  motivation 
and  inlere-t  are  unlikelv  lo  lie  high,  and  (e)  while  increasing  reading  lime  would  -cent  lo  he  a 


reliable  ami  straightforward  #a\  In  increase  lesl  comprehension,  the  results  of  ibis  study  indicated 
that  the  learning  efficiency  of  ibis  approach  is  not  high.  Therefore,  in  applying  this  approach  to 
particular  situations,  it  may  be  well  to  careful!)  anal)  ze  whelher  the  gain  in  comprehension  is  worth 
the  extra  expenditure  of  reading  time.  (<>l  pages) 

23  Purifoy.  h.R„  Jr.,  &  Benson.  K.fl.  Muititenanee  training  simulators  design  and  acquisition: 
Summary  of  current  procedures.  AFHRL-TR-79-23.  AD-A079  636.  Lowry  AFB.  (At: 
Technical  Training  Division,  November  1979.  Project  2361.  Contract  F33615-78-C-0019. 
Applied  Science  Associates,  Incorporated.  NTIS.  This  technical  report  is  the  first  in  a  series  that 
w  ill  explore  the  problems  of  maintenance  training  simulation  design  and  acquisition.  It  is  focused  on 
the  existing  procedures  followed  b\  \ir  Force  personnel  in  performing  Instructional  Svsteins 
Development  (ISD)  analyses  to  define  maintenance  training  equipment  requirements,  and  b\ 
Svsletn  Program  Office  fSPO)  Training  Equipment  Acquisition  Managers  in  accomplishing  training 
equipment  procurement.  Later  reports  in  this  series  will  structure  appropriate  functional 
specifications  for  the  acquisition  of  maintenance  training  simulators,  will  present  handbooks  to 
guide  ISD  analysts  in  selecting  appropriate  types  ol  maintenance  training  equipment  and  in 
designing  and  documenting  required  maintenance  training  simulator  characteristics  and  features, 
and  to  guide  SPO  \equisilion  Managers  in  preparing  Prime  Item  Specifications. 

In  this  report  both  the  ISD  and  SPO  procedures  are  described  as  ibex  are  eurrentlx  accomplished. 
Relevant  documentation  is  cited  and  a  comprehensive  bibliographx  is  included.  For  each  of  the  two 
sets  id  procedures,  a  general  decision  model  is  presented  as  a  reference,  and  general  problem  areas 
which  appear  to  be  degrading  the  ultimate  cosl-etleeliieness  of  maintenance  simulators  are 
discussed.  (H<>  pages) 

21  McManus.  J.C..  Equipment  comparability  techniques  used  during  early  system  design.  AF1IRL- 
TR-79-2  f.  AD-A07I  IT  I.  M  righl-Palterson  AFB.  Oil:  Advanced  Systems  Division.  Julv  1979. 
Project  ASDS.  NTIS.  \  simple  and  accurate  process  is  needed  for  comparing  proposed  equipment 
to  existing  operational  equipment  in  order  to  forecast  the  resources  required  to  support  the  proposed 
equipment.  Maintenance  manpower  modeling  needs  such  a  process  to  predict  manpower,  spares, 
and  support  equipment  ol  newly  designed  weapon  systems. 

\s  a  lirsl  step  toward  developing  the  needed  techniques  for  comparing  old  and  new  equipment,  a 
systematic  study  was  made  of  the  present  state-of-the-art.  Otrreni  literature  was  reviewed, 
personnel  who  perform  eoutparabilitx  analysis  were  interviewed,  and  past  eomparabililx  studies 
were  analyzed.  This  effort  found  that  a  distinction  should  be  made  between  the  broad  topic  of 
"comparability  studies'  and  the  specific  procedures  of  "comparability  analvsis.’  \  comparability 
study  i'  the  overall  process  used  to  estimate  resource  requirements  for  new  equipment  using  the 
procedures  of  comparability  analysis  to  find  operational  equipment  which  is  similar  to  the  proposed 
equipment. 

It  also  was  found  that  no  standardized,  reliable  procedure  exists  lor  performing  eomparabililx 
studies  including  comparability  analysis,  ft  is  recommended  that  a  quantitative  procedure  be 
developed  lor  comparing  new  equipment  with  equipment  in  the  operational  inventory.  It  is  further 
recommended  that  a  quantitative  procedure  be  developed  for  computing  an  adjustment  factor 
relating  the  operational  equipment  to  the  proposed  equipment.  (I  1  pages) 

23  Nataupsky.  M.,  Waag.  W.l...  Wcyer,  D.C...  MeFadden.  R.W..  &  McDowell.  K.  Platform  motion 
contributions  to  simulator  training  effectiveness:  Study  111  —  Interaction  of  motion  w  ith  field- 


of-view.  AKHRL-TK-79-25.  AD-A078  f26.  Williams  AKB,  AZ:  Flying  Training  Division, 
INoventlier  1979.  Project  I  12.1.  NTIS.  The  objective  of  this  stud)  was  to  determine  the  effects  of 
platform  motion  cueing,  visual  field  of  view  (FOX).  and  their  interaction  upon  learning  in  the 
simulator  and  as  subsequent  transfer  of  training  to  the  aircraft  for  basic  contact  maneuvers  in  the  T- 
17  aircraft.  \  transfer-of-training  studs  design  was  used  in  which  student  pilots  were  initially 
trained  in  the  Advanced  Simulator  for  Pilot  Training  (ASPT)  and  subsequently  evaluated  on  their 
lirst  sortie  in  the  1-17  aircraft.  F’.ach  student  received  training  under  one  of  lour  simulator 
configurations:  (a)  full  platform  motion  (six  degrees  of  freedom),  full  FOX  (100°  horizontal  hv  110° 
vertical):  (h)  full  platform  motion,  limited  FOX  08°  horizontal  by  10°  vertical):  (e)  no  platform 
motion,  full  FOX  :  and  (d)  no  platform  motion,  limited  FOX  .  for  tin-  ASPT  prclraining  phase,  scores 
from  the  automated  performance  measuring  system  attd  overall  instructor  pilot  ratings  were  used 
for  analysis.  For  the  1-17  evaluation  sorties,  the  overall  instructor  pilot  ratings,  as  well  as 
individually  recorded  flight  parameters,  were  analyzed.  These  data  provided  no  conclusive  evidence 
ol  differential  transfer  effects  resulting  from  platform  motion  cueing,  size  of  ( lit-  visual  FOX.  or 
their  interaction.  As  such,  these  data  provide  support  for  previous  findings  that  platform  motion 
cueing  docs  not  significantly  enhance  (he  transfer  of  learning  for  basic  contact  tasks  in  the  T-17 
aircraft.  It  would  seem  that  the  impact  of  peripheral  visual  cues  for  initial  acquisition  is  mil  critical. 
Furthermore,  no  convincing  evidence  was  found  indicating  increased  transfer  using  platform 
motion  in  conjunction  with  a  narrow  FOX  visual  scene.  The  major  implication  from  these  findings  is 
that  a  fixed-base .  limited  FOX  simulator  configuration  provides  sufficient  cueing  lor  basic  contact 
skills  normally  trained  during  l  ndergraduate  Pilot  Training.  (10  pages) 

26  W  illiams.  H.J.  Air  Force  Human  Resources  Laboratory  Annual  Report  —  Fiscal  Year  1978. 
AFIIRI.-TR-79-26.  AD-A069  719.  Brooks  AFB.  TX:  Headquarters  Air  Force  Human 
Resources  Laboratory,  May  1979.  (Covers  all  AFHR1.  projects.)  NTIS.  This  report 
comprehensively  describes  the  organizational  structure  of  the  Air  Force  Human  Resources 
Laboratory  and  the  functions  of  its  Divisions  and  Operating  Locations.  It  presents  the  technical 
achievements  of  the  Laboratory  for  Fiscal  A  ear  1978.  svnopsiz.es  promising  on-going  research 
projects,  discusses  the  available  technical  resources,  ami  lists  publications  and  presentations  hv 
Laboratory  personnel  during  Fiscal  Year  1978.  (88  pages) 

27  Soland.  I)..  Xoth.  XL.  &  Nareiulra,  P.  Real-time  feasibility  for  generation  of  nonlinear  textured 
terrain.  AFIIRL-TR-79-27.  AD- .4095  070.  W  illiams  AFB.  AZ:  Operations  Training  Division. 
January  1981.  Project  1958.  Contract  F116I5-77-C-0071.  Honeywell.  Systems  and  Research 
Center.  NTIS.  This  study  was  conducted  bv  Honey  well  for  the  Xir  Force  Human  Resources 
Laboratory  (  XFIIRI.)  in  order  to  evaluate  and  study  a  potential  new  approach  lor  the  simulation  of 
visual  and  sensor  imagery  for  Xir  Force  training  applications.  This  report  describes  the  hardware 
implementation  of  a  curved-surface  method  for  computer  image  generation  (CM I)  of  textured 
terrain  imagery .  Ceucral  comments  ami  details  of  the  algorithms  are  presented.  I  bis  is  followed  by  a 
discussion  of  the  hardware  for  a  real-time  implementation  of  this  technique. 

The  approach  involves  the  display  of  terrain  as  curved  surfaces  represented  by  bicubic  splines. 
Texture  patterns  may  then  be  mapped  to  these  surfaces.  Buildings  or  man-made  features  may  be 
drawn  using  polygonal  surfaces. 

This  curved  approach  is  of  interest  because  it  may  represent  a  more  cost-effective  method  to  include 
more  detail  in  the  simulated  imagery .  ( iurrent  systems  are  constrained  to  the  use  of  straight  edges  in 
the  representation  of  real-world  features  and  require  large  numbers  of  edges  to  display  complex, 
irregular  objects  such  as  terrain.  Therefore,  the  curved  surface  approach  may  demonstrate  many 
advantages  over  the  straight  edge  technique.  (Ilf  pages) 


28  King,  C.F.,  A  Askren,  W.B.  Human  resources,  logistics,  and  cost  factors  in  weapon  system 
development:  Demonstration  in  conceptual  and  validation  phases  of  aircraft  system 
acquisition.  AFHRL-TR-79-28(I),  AD-A075  272.  Wright-Patterson  AFB,  OH:  Advanced 
Systems  Division,  September  1979.  Project  1959,  Contract  F33615-77-C-0016,  Dynamics 
Research  Corporation.  NT1S.  A  methodology,  the  coordinated  human  resource  technology 
(CHRT).  was  developed  to  quantify  critical  human  resource,  logistics,  and  cost  factors  throughout 
aircraft  acquisition,  knowledge  of  these  factors  helps  influence  the  selection  of  a  system  and  support 
design  approach.  The  factors  quantified  are  manpower,  training,  technical  documentation,  and 
system  ownership  costs.  Reliability  and  maintainability,  both  of  which  directly  affect  the  foregoing, 
are  also  quantified.  The  CHRT  methodology  also  implements  an  integrated  approach  to  personnel, 
training,  and  technical  documentation,  and  operates  from  a  single,  evolving  consolidated  data  base. 


This  report  describes  two  parts  of  a  three-part  demonstration  of  CHRT  application  on  an  aircraft 
acquisition  program.  Parts  1  and  2.  respectively,  use  conceptual  and  validation  (prototype)  phase 
data  on  avionics  and  landing  gear  systems  of  the  Advanced  Medium  STOL*  Transport  (AMST).  The 
res  ults  are  presented  and  evaluated  for  various  design,  personnel,  training,  and  technical  data 
alternatives.  CHRT  is  demonstrated  as  an  acquisition  management  tool  which  initiates  the 
development  of  detailed  logistic  and  cost  data  early  in  acquisition  and  provides  data  source 
continuity  throughout  acquisition.  Part  3  of  the  demonstration  will  use  data  projected  for  the  AMST 
minimum  engineering  development  (MFD)  phase.  This  phase  is  similar  to  full-scale  development. 
(%  pages) 


29  King,  G.F.,  A  Askren,  W.B.  Human  resources,  logistics,  and  cost  factors  in  weapon  system 
development:  Demonstration  in  conceptual  and  validation  phases  of  aircraft  system 
acquisition  —  Appendix  A.  AFHRL-TR-79-28(II),  AD-A075  209.  Wright-Patterson  AFB, 
OH:  Advanced  Systems  Division,  September  1979.  Project  1959,  Contract  F33615-77-C-0016, 
Dynamics  Research  Corporation.  NTIS.  The  Coordinated  Human  Resource  Technology  and  the 
Consolidated  Data  Base  have  been  demonstrated  in  the  conceptual  and  validation  phase  of  weapon 
system  acquisition.  The  results  of  this  demonstration  are  reported  in  AFHRL-TR-79-28(l).  This 
report  (Volume  II)  constitutes  Appendix  A  to  that  demonstration  report  and  provides  additional 
details  of  the  demonstration.  (116  pages) 


30  Hendrix,  W.H.,  Ward,  J.H.,  Jr.,  Pina,  M.,  Jr.,  A  Haney,  D.L.  Pre-enlistment  person-job  match 
system.  AFHRL-TR-79-29,  AD-A078  427.  Brooks  AFB,  TX:  Occupation  and  Manpower 
Research  Division,  September  1979.  Project  2077.  NTIS.  Research  discussed  in  this  report 
involved  the  development  of  a  computer-based  assignment  system  which  became  operational  Air 
Force  wide  1  November  1976.  The  Person-Job  Match  System  was  the  computer  algorithm  which 
matched  potential  recruits  with  available  jobs.  This  algorithm,  when  operationally  implemented, 
became  the  assignment  algorithm  of  the  Air  Force  Advanced  Personnel  Data  System’s  Procurement 
Management  Information  System  (APDS-PROMIS).  This  report  presents  the  assignment  concept, 
methods  of  combining  multiple  objectives,  the  conceptual  payoff  equation,  baseline  performance 
data,  and  future  directions  anticipated.  (98  pages) 


'Short  takeoff  and  landing. 


31  Kraft,  C.L.,  Anderson,  C.D.,  &  Elworth,  C.L.  Psychophysical  criteria  for  visual  simulation 
systems.  AFHRL-TR-79-30,  AD-A084  776.  Williams  AFB,  AZ:  Operations  Training  Division, 
May  1980.  Project  61  I  t,  Contract  F33615-78-C-0012.  Boeing  Aerospace  Company  .  NTIS.  This 
contractual  effort  studied  a  prioritized  list  of  psychophysical  aspects  of  visual  simulation  systems  for 
military  flight  training  simulators.  The  available  literature,  operational  experiences  of  simulator 
commands,  current  research  program  data  were  assembled,  organized,  reviewed,  evaluated  and 
summarized  to  provide  psychophysical  criteria  for  the  visual  displays  subsystem,  \reas  of 
insufficient  data  were  identified,  and  seven  experimental  designs  were  suggested  for  psychophysical 
investigations  to  provide  some  of  the  missing  data.  (1  14  pages) 


32  Hendrix,  W.H.,  &  Halverson,  Y.B.  Personnel  and  background  differences  in  organizational 
effectiveness.  AFHRL-TR-79-31.  AD- .4090  102.  Brooks  AFB.  TX:  Manpower  and  Personnel 
Division.  September  1980.  Project  2313.  NTIS.  Research  involved  a  series  of  one-way  and  two- 
way  analyses  of  variance  (ANON  V)  to  establish  significant  differences  between  response  options 
associated  with  Background  Information  items  from  the  Organizational  \sscssmenl  Package  (0\P). 
Significant  main  effects  and  interactions  resulted  in  tests  for  simple  main  effects  and  post-hoc 
analyses  to  establish  specific  mean  pairs  w  hich  differed  significantly  from  each  other.  Four  criteria 
which  served  as  dependent  variables  in  the  \NO\  \s  were  (a)  Ceneral  Organizational  Climate,  (h) 
Organizational  Communications  Climate,  (e)  Job  Related  Satisfaction,  and  (d)  Perceived 
Product iv  its.  These  criteria  were  collected  with  the  O  \P.  and  were  four  orthogonal  factors  extracted 
during  a  previous  study .  \  few  of  the  significant  differences  found  were  that,  overall,  those  who 
were  in  an  organization  more  than  36  months  scored  higher  on  the  criteria  than  did  other  groups  of 
individuals.  Supervisors  of  larger  numbers  of  people  also  scored  higher  than  did  other  groups  of 
individuals.  \  supervisor  who  used  work  group  meetings  to  set  goals  and  solve  problems  resulted  in 
his  workers  being  more  satisfied,  and  perceived  productivity  and  the  organization's  climate  to  he 
better.  Civilians  reported  higher  job  related  satisfaction  than  did  officers  and  airmen,  \irmen 
perceived  work  group  productivity  to  be  lower  than  did  officers  and  civilians.  (90  pages) 


33  Rueter.  F.H.,  llillman.  R.C..  A  Bell.  T.R.  Design  of  a  national  skills  market  model  for  Air 
Force  enlisted  personnel.  AFHHI.-TR-79-32.  AD-4075  273.  Brooks  AFB.  I  \:  Occupation  and 
Manpower  Research  Division.  September  1979.  Project  2313.  Contract  F336l5-7H-(.-(MI29. 
CONSAI)  Research  Corporation.  NTIS.  This  technical  report  documents  the  detailed 
specifications  developed  in  this  study  describing  feasible  options  available  lor  designing  and 
implementing  the  National  Skills  Market  Model  —  an  empirically  based  forecasting  model  ol 
economic  activity  in  the  industrial  and  occupational  labor  markets  in  which  the  \ir  force  competes 
for  labor.  Essentially .  the  model  formulated  in  this  study  consists  of  three  basic  analy  lie  components 
which,  in  combination,  produce  detailed  forecasts  of  national  labor  market  conditions,  and  generate 
projections  of  the  total  accession  and  retention  of  \ i r  Force  enlisted  personnel.  The  basic  analytic 
component'  include  a  non-mililarv  labor  market  module,  a  population  projection  module,  and  an 
accession/ retention  rale  forecasting  module.  Mach  of  these  components  is  then  subdivided  into  one 
or  more  analytic  elements  which  address  distinct  aspects  of  the  general  issue  examined  in  the 
analv  lie  component.  In  all.  nine  analy  tie  elements  are  included  in  the  modular  design  of  the  model. 
The  report  describes  the  functions  to  fie  performed  bv  each  of  the  analytic  components  and 
elements,  and  specifies  the  procedures  through  which  each  element  has  boon  designed  to 
accomplish  its  functions.  Recommendations  for  the  development  and  implementation  of  the  model 
are  presented  also.  Detailed  supporting  information  is  provided  in  appendices.  (IH0  pages) 


34  kalisch,  S.J..  Jr.  Computerized  instructional  adaptive  testing  model:  Formulation  and 
validation.  AFHRL-TR-79-33.  AD-A08I  855.  Lowry  AFB.  CO:  Technical  Training  Division. 
February  1980.  Project  2313.  Contract  F’336 1 5-77-C-007I.  Control  Data  Education  Company. 
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NTIS.  The  study  included  a  formulation  of  eight  versions  of  an  adaptive  testing  model  and 
computer  simulations  used  to  compare  the  accuracy  and  efficiency  of  the  versions  to  each  other  and 
to  conventional  testing  modes.  The  adaptive  testing  model  was  designed  to  be  applicable  to  the 
needs  and  problems  incurred  in  assessing  mastery/non-mastery  of  instructional  objectives  by 
trainees.  The  overall  purpose  was  to  design  a  testing  model  that  could  provide  greater  accuracy  in 
mastery/non-masterv  classifications  with  fewer  test  items  than  are  presented  with  conventional 
tests.  The  study  included  two  phases  of  computer-simulated  tests  of  the  models.  The  first  phase 
employed  Monte  Carlo  simulations:  the  second  used  existing  data  obtained  from  trainees  in  a 
Weapons  Mechanics  training  course.  The  results  of  the  first  phase  showed  that  one  of  the  versions 
was  superior  in  accuracy  to  a  conventional  testing  procedure.  Although  the  other  versions  provided 
the  same  accuracy  as  the  conventional  mode,  selection  of  other  error  parameters  would  probably  be 
able  to  increase  the  accuracy  of  the  adaptive  testing  versions.  All  the  adaptive  versions  required 
significantly  fewer  items  to  make  mastery/non-maslery  derisions.  In  the  second  phase,  two  of  the 
adaptive  versions  were  selected  for  comparison  using  data  from  actual  trainees.  The  results  showed 
the  adaptive  testing  models  could  provide  the  same  decisions  as  are  made  now  by  the  Air  Force  in 
the  Weapons  Mechanics  course,  except  that  on  the  average  75  percent  fewer  test  items  would  be 
needed.  It  was  concluded  that  the  adaptive  testing  model  could  be  used  to  substantially  reduce 
testing  time  and  maintain  the  present  level  of  accuracy  in  decision  making,  not  only  in  Weapons 
Mechanics  but  also  in  other  courses  requiring  the  same  types  of  decisions.  (106  pages) 

.15  Thomas,  F.L..  &  Hankins,  R.J.  Use  of  human  resources  data  in  weapon  system  design: 
Identification  of  data/data  systems  and  related  technology.  AFHRL-TR-79-36,  AD-A080  598. 
Wright- Patterson  AFB,  OH:  Advanced  Systems  Division,  January  1980.  Project  1124, 
Contract  F33615-78-C-0010,  Clemson  University.  NTIS.  The  objective  of  this  study  is  to 
establish  criteria  for  development  of  a  l  nified  Data  Base  of  human  resources  information  for  use  in 
system  design.  Existing  data,  data  systems,  and  technology  related  to  the  use  of  human  resource 
factors  in  weapon  system  design  are  identified  and  briefly  discussed.  Topics  discussed  include 
Maintenance  Data  Collection  System.  Maintenance  Cost  System.  Human  Resources  Technology.  Life 
Cycle  Costing.  Air  Force  Logistic  Command  Data  Systems.  Parametric  Estimating  Relationships,  and 
data  systems  other  than  Air  Force.  (134  pages) 

36  Cray,  T.H.  Boom  operator  part-task  trainer:  Test  and  evaluation  of  the  transfer  of  training. 
AFHRL-TR-79-37,  AD-A079  796.  Williams  AFB,  AZ:  Flying  Training  Division,  October 
1979.  Project  1 123.  NTIS.  The  report  presents  the  rationale,  methodology  and  results  of  a  study  of 
the  training  capabilities  of  the  Boom  Operator  Part-Task  Trainer  (BOPPT).  an  air  refueling 
simulator.  The  study  was  performed  as  part  of  an  Air  Force  Initial  Operational  Test  and  Evaluation 
(IOT&F.)  of  the  device.  Actually,  three  transfer  of  training  sub-studies  were  conducted 
simultaneously:  the  first  with  undergraduate  boom  operators  in  the  Combat  Crew  Training 
Squadron  (CUTS)  ph  ase  of  instruction:  the  second  with  instructor  boom  operators  in  the  Central 
Flight  Instructor  Course  (CFIC):  and  the  third  with  highly  experienced  boom  operators  who  were 
maintaining  essential  skills. 

In  the  CCTS  application,  it  was  found  that  all  student  groups  trained  in  the  BOPTT  required 
significantly  fewer  air  refueling  attempts  (50  versus  71)  to  reach  proficiency  in  KC-135A  air 
refueling  skills  than  did  conventionally  trained  students.  In  boom  operations,  procedures,  and 
communications,  the  BOPTT  trained  students  were  equal  or  superior  to  the  students  in  the  standard 
syllabus.  Also,  proper  utilization  of  the  BOPTT  could  avoid  over  one  million  dollars  in  training  costs 
per  year. 


I' or  I  In*  (.IK.  application.  tin-  data  -how  that  trainees  who  received  all  training  sessions  in  the 
IM)P  I  I  demonstrated  pr«>l  icieney  equal  to  llial  ol  i  n  >t  mil  nr  Irai  nees  w  ho  received  all  I  raining!  in  l  hr 
K(  .-I8.»A  airrratl.  The  1:1  training  transfer  ratio  afforded  h\  I  In-  direct  substitution  ol  BOPTT 
training  lor  airrrall  training  is  striking  confirmation  of  device  effectiveness. 

Finally.  ihr  skill  mainlrnanrr  ilala  rrM-alril  that  no  measurable  degradation  of  hooni  o|irralor  -kith 
.occurred  lor  ihr  duration  ol  ihr  two  lest  (irriod-  ((>0  and  120  ilaxs).  Coiisequeiillx .  mi  conclusions 
rould  hr  draw  n  concerning  ihr  rl  feiiiveness  ol  ihr  IK  H’TT  in  main  lain  in);  ihr  |irofirirnr\  of  high  lx 
'killed  hooni  iqieralnrs.  (70  pages) 

•'<7  Bailrv.  J.S.,  X  Hughes.  K.C.  Applied  hrhavinr  analysis  in  fixing  training  rrsrarrh.  AFT1KI.-TK- 
71-38.  AD-A081  780.  Williams  Afll,  AZ:  Fixing  Training  Division.  Jannarx  1980.  Project 
I  1 28.  NT  IS.  Hrsearrh  developments  in  learning  llirorx  ox rr  ihr  past  .>0  x rar>  hax  r  led  In  principles 
ol  hr  hax  ior  wliirh  have  hern  show  n  in  innnmerahle  applied  sellings  to  he  valuable  in  ana  lx  zing  and 
modifying  human  hehaxior.  %  lien  applied  lo  fixing  training  using  simulalors.  llirsr  principle- 
suggest  that  a  signifiranl  ronlrihulion  roulil  hr  made  in  improxing  the  wax  in  wliirh  Instructor 
Pilots  Irarh  nrxx  sludenls  xia  more  eflerlive  use  of  simulator  fuitrlious.  In  addition,  fixing  skill- 
could  probably  hr  acquired  more  readily  it  task-  xxrrr  prrsrulrd  in  a  more  -xslematic  iiianurr. 
taking  the  prinriplrs  ol  learning  into  account.  W  lieu  the  simulator  is  conceptualized  as  mrrrlx  an 
interior  copy  ol  an  airrral I.  it'  potential  a-  a  leaching  drx  ice  (perhaps  superior  lo  the  actual  plane,  in 
this  regard)  is  likely  to  lie  oxerlooked.  Thus,  a  lieliax  ioral  aualxsis  of  optimal  conditions  of  learning 
would  make  a  major  ronlrihulion  to  hullt  the  design  and  use  of  current  and  future  flight  simulator'. 
In  this  report,  an  attempt  is  made  to  elucidate  the  basic  principles  of  lieliax  ior  and  lo  relate  them  lo 
the  task  of  improving  fixing  training.  (18  pages) 

88  Marcus.  C.H..  Patterson.  J.  I'.,  Bennett.  (!.!)..  X  Cershan.  B.S.  Cost-effectiveness  inelhodologx 
for  aircrew  training  devices:  Model  development  and  users  handbook.  AFHKL-TK-79-89.  AD- 
BO  14  768L.  Williams  AFB.  AZ:  Fixing  Training  Division.  Fcbruarx  1980.  Project  1128. 
Contract  F8861 8-77-C-0072,  Analytic  Services  Incorporated.  DTIC.  This  report  doeumeul'  the 
development  ol  a  new  methodologx  to  examine  tile  cosl-eflecliveiiess  of  alternative  aircrexx  training 
devices  and  systems.  The  methodologx  is  comprelieiisixe  and  liighlx  flexible  and  uses  detailed  cost 
ami  training  inlormaliun  on  the  devices  ami  the  training  program.  The  report  is  intended  to  he 
useful  both  as  a  reference  on  the  technical  aspects  ol  the  model  development  and  as  a  users 
handbook  lor  operating  the  computer  software.  (280  pages) 

89  Lintz.  L.M.,  Pennell.  R..  X  Yasulake.  J.Y.  Integrated  system  lest  of  the  Advanced  Instructional 
System  (AIS).  AFHRL-TR-79-T0.  AD-A08I  88  f.  Lowry  AFB.  CO:  Technical  Training 
Division.  December  1979.  Project  1198,  Contract  F.3861 5-78-C-T00T.  McDonnell  Douglas 
Astronautics  Company — St.  Louis.  INTIS.  The  integrated  system  lest  lor  the  \dvanced 
Instructional  Sxstem  (AIS)  xxas  designed  lo  provide  quantitative  answers  regarding  the  training  lime 
reductions  resulting  from  certain  computer-managed  instruction  (CMI)  functions  of  the  \ IS.  The 
reliabilities  of  the  CMI  functions  and  of  the  AIS  support  sx stems  (media,  eompuler  hardware,  and 
software)  were  also  inve-ligated. 

Testing  established  that  conversion  of  the  conventional  lockstep  Invcntorx  Management  (IM)  course 
to  self-pacing  with  basic  CMI  functions  reduced  training  lime  by  88V  In  the  Material  Facilities  (MF) 
course,  the  reduction  was  2FV  in  Precision  Measuring  F.quipmenl  (PMF.).  81V  and  in  Weapons 
Mechanic  (WM).  81V  Student  progress  management  (SPM).  an  additional  CMI  capability  which 
gives  frequent  feedback  lo  the  student  ami  instructor  regarding  the  student’s  progress  toward  a 
computer-generated  target  graduation  dale,  resulted  in  additional  savings  of  I0"«  in  IM.  0.7"u  in  MF. 
.’).l"(i  in  PMF..  and  18.8""  in  WM.  Individualized  instructional  assignment  (II \).  another  CMI 


capabilitv  whi'ri'lit  a  student  is  a^igunl  hi  ihiw  alternative  instructional  treatments  dial  arc 
predicted  lo  lie  best  for  that  student.  resulted  in  additional  savings  in  die  IM  course  — 
individiiali/alion  in  onc-fourlli  of  die  course  reduced  die  average  lime  in  course  by  !1V 

Heliatiiti I \  and  iiiaiiilainaliilit \  data  collected  during  tile  integrated  svsteni  test  indicated  that  die 
(All  support  functions,  the  media  devices  and  courseware,  and  the  computer  hardware  and  software 
met  or  exceeded  MS  requirements. 

I'he  lessons  learned  during  MS  development  were  extrapolated  lo  provide  estimates  of  courseware 
development  limes  that  should  he  realizable  in  converting  lockstep  instruction  lo  MS  computer- 
based  instruction.  (HKi  pages) 

-M)  K1  worth.  C.  Instructor/ operator  display  evaluation  methods.  AFHRL-TR- 79-41,  AD-A097  208. 
Williams  AFB,  AZ:  Operations  Training  Division,  March  1981.  Project  6114,  (ion tracts  F33615-77-C- 
0017  and  F33615-78-C-0051,  Boeing  Aerospace  Company.  NT1S.  The  purpose  of  this  study  was  to 
develop  an  objective,  systematic  technique  for  evaluating  alternative  formats  for  the  displays  to  be 
used  at  the  instructor/operator  station  (IDS)  of  a  flight  simulator.  A  benchmark  performance 
monitoring  task  was  designed  which  exercises  many  of  the  skills  used  by  an  instructor  at  a  remote 
IOS.  Measurement  techniques  were  developed  for  assessing  performance  of  the  task.  The  techniques 
were  demonstrated  by  using  them  to  compare  two  popular  displav  formats:  digital  readouts  versus 
repeater  instruments.  Three  of  six  variables  were  monitored  with  greater  accuracy  and 
comprehensiveness  using  repeater  instruments  than  digital  readouts.  For  the  other  three  variables, 
there  was  no  difference  between  display  types.  Significant  effects  were  caused  by  both  the  type  of 
maneuver  being  flown  and  the  type  of  question  being  asked  in  administering  the  measurement 
method.  Vie  concluded  that  tile  benchmark  task  approach  has  considerable  merit  as  a  method  of 
evaluating  display  formats.  In  follow-on  studies,  additional  investigations  should  be  conducted  on 
the  specifies  of  the  measurement  technique  and  the  possible  effects  of  memory  on  results.  (192 
pages) 


1 1  l.inlz.  I..M..  Tale.  T..  Pflasterer.  IM!..  Nix.  <!.J..  Klein.  T.C..  &  (dick.  LK.  Low-Cost  Computer- 
Aided  Inslruclion/Computcr  Managed  Instruction  ((!AI/(!MI)  system:  Feasibility  study. 
AFHKI.-' TR-79- 12.  AD-.A08I  072.  Lowry  AFB.  (!():  Technical  Training  Division.  December 
1979.  Project  1121.  Contract  F336 1 5-78-C-003 1 .  McDonnell  Douglas  Astronautics 
Compauv — St.  Louis.  NIIS.  Ibis  sludx  investigated  the  feasibility  of  a  low -cost  computer-aided 
iiislruelion/eompuler-managed  instruction  (CM/CMI)  system.  \ i r  Force  instructors  and  training 
supervisors  were  sttrveved.  to  determine  the  potential  paxolls  ol  various  CM  anti  (All  (unctions. 
Ilesulls  militated  that  a  wide  range  of  capabilities  bail  potential  for  resident  tecltuieal  training. 
Survexs  of  selected  computers,  terminals,  communications,  and  support  software  identified 
candidates  lor  the  low  cost  >v strut,  (l  it  pages) 


12  Dobrovoluv .  J.L..  McCombs.  ILL..  «  Judd.  W.A.  Study  skills  package:  Development  and 
evaluation.  AFIIKL-TK-79- 1.1.  AD-A083  2.12.  Lowry  AFB.  CO:  Technical  Training  Division. 
March  1980.  Project  1121.  Contract  MD A-90.1-77-0 1  1 1.  McDonnell  Douglas  Astronautics 
Compauv— St.  Louis.  NTIS.  Materials  contained  within  ibis  report  are  designed  lo  diagnose  and 
remedx  student  -luilx  skill  deficiencies  in  the  areas  ol  (a)  reading  comprehension.  (Id 
memorization,  (e)  test  taking,  and  (d)  concentration  management  skills.  I  be  study  skills  material- 
were  srparalclv  packaged  lo  allow  partial  or  total  remediation  in  the  four  area-,  as  required,  and 
each  package  incorporated  concepts  of  active  student  involvement  in  the  material  to  be  learned  (c.g.. 
mnemonic  techniques,  behavioral  self-control  strategies).  In  addition,  materials  and  procedure- 
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used  in  an  Instructor  Orientation  and  Training  Workshop  arc  included.  A  package  was  designed  to 
provide  instructors  using  computer-managed  instruction  with  basic  diagnostic  and  tutorial  skills 
required  to  assist  in  their  effective  use  of  the  study  skills  materials  and  to  help  them  transition  into 
their  new  role  as  facilitator  of  student  learning.  Kvalualion  data  from  an  implementation  of  the 
student  and  instructor  skill  training  materials  in  the  Air  Force  Advanced  Instructional  System 
suggest  that  consistent  student  training  time  reductions  and  performance  gains  can  he  obtained  by 
the  use  of  the  study  skills  materials.  The  Study  Skills  Questionnaire  was  also  found  to  be  a  reliable 
and  valid  measure  of  student  skills  in  the  four  areas,  and  reliably  discriminated  students  performing 
satisfactorily  versus  poorly  in  the  Advanced  Instructional  System  technical  training  environment. 
Furthermore,  the  Instruction  Orientation  and  Training  was  found  to  assist  in  the  efficient 
remediation  of  student  study  skill  deficiencies  and  to  contribute  to  improved  instructor  perceptions 
of  their  role  in  computer-managed  instruction.  ( 1  ‘>0  pages) 

43  DeMaio,  J.C.,  A  Eddowes,  E.E.  Airborne  performance  measurement  assessment:  Low  altitude 
tactical  formation  in  two  operating  environments.  AFHRL-TR-79-44.  AD-A087  068.  Williams 
AFB,  AZ:  Operations  Training  Division,  July  1980.  Project  1123.  INTIS.  A  methodology  was 
developed  to  assess  pilot  performance  in  low  altitude  taetical  formation  (I.ATF)  and  to  relate  overall 
performance  to  performance  on  suhlasks  necessary  to  mission  success.  The  methodology  was 
employed  to  evaluate  the  performance  of  28  pilots  assigned  to  an  operational  A-7  squadron.  The 
methodology  was  found  to  provide  a  consistent  measure  of  pilot  performance  and  to  reveal  the 
importance  of  certain  pilot  skills  to  the  I.ATF  task.  Performance  ratings  were  obtained  under 
routine  operating  conditions  and  under  conditions  of  simulated  combat.  Differences  were  obtained 
in  performance  ratings  under  the  two  conditions.  Implications  for  currency  training  were  discussed. 
(18  pages) 

44  Eschenbrenuer,  A.J.,  Jr.,  DeVries,  P.B.,  Jr.,  Miller,  J.T.,  &  Ruck,  H.W.  Methods  for  collecting 
and  analyzing  task  analysis  data.  AFHRL-TR-79-45(I).  AD-A087  710.  Brooks  AFB,  TX: 
Manpower  and  Personnel  Division,  July  1980.  Project  1LIR,  Contract  F33615-77-C-0076, 
McDonnell  Douglas  Astronautics  Company  — St.  Louis.  INTIS.  Task  analysis,  a  critical  front-end 
activity  in  the  Instructional  System  Development  methodology,  is  the  process  of  partitioning  job 
tasks  into  their  component  subtasks  and  identifying  the  skills  and  knowledges  required  to  support 
task  performance.  This  study  was  initiated  in  response  to  a  Request  for  Personnel  Research 
generated  by  the  Air  Training  Command,  which  noted  that  "a  wide  range  of  nonstandardized  task 
analysis  procedures  are  in  use  throughout  the  training  community."  Implementation  of  a 
standardized  procedure  for  identifying  essential  subtasks  and  supporting  skills  and  knowledges  was 
expected  to  hold  considerable  potential  for  increasing  training  efficiency  and  reducing  training 
costs.  A  simplified  task  analysis  procedure  and  documentation  system  was  specified,  and  a  task 
analysis  handbook  was  prepared.  Handbook  procedures  were  field  tested  at  six  Air  Force 
installations.  Results  indicated  that  the  handbook  procedures  met  the  design  criteria  of  simplicity, 
validity,  reliability,  and  time-efficiency/effectiveness.  The  feasibility  and  utility  of  implementing  a 
computer-based  task  analysis  data  bank  was  assessed,  and  a  preliminary  data  bank  design  was  then 
developed.  Additionally,  two  technology  transfer  seminars  were  conducted  to  assist  Air  Force 
personnel  in  applying  handbook  task  analysis  procedures.  (174  pages) 

45  DeVries,  P.B.,  Jr.,  Eschenbrenner,  A.J.,  Jr.,  &  Ruck,  H.W.  Task  analysis  handbook.  AFHRL- 
TR-79-45(II),  AD-A087  71 1.  Brooks  AFB,  TX:  Manpower  and  Personnel  Division,  July  1980. 
Project  1LIR,  Contract  F33615-77-C-0076,  McDonnell  Douglas  Astronautics  Company — St. 
Louis.  NTIS.  The  handbook  provides  a  validated  set  of  procedures  and  guidelines  for  analyzing 
tasks  into  subtasks  and  supporting  skills  and  knowledge.  The  handbook  is  designed  for  use  in 
technical  training  by  subject  matter  experts.  It  assumes  that  tasks  have  already  been  selected  for 
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training,  that  trainee  profieiency  levels  have  been  determined,  and  that  the  trainee  population  is 
known. 

There  are  three  major  stages  of  the  task  analysis  procedure  contained  in  the  handbook.  They  are:  (a) 
Development  of  preliminary  performance  requirements  (PPRs).  (b)  identification  of  subtasks,  (c) 
Identification  of  supporting  skills  and  knowledge.  (72  pages). 


46  Hendrix,  W.H.  Organizational  assessment  indices  of  effectiveness.  AFHRL-TR-79-46,  AD- 
A081  073.  Brooks  AFB,  TX:  Occupation  and  Manpower  Research  Division,  December  1979. 
Project  2313.  NTIS.  The  research  discussed  in  this  report  involved  developing  indices  of 
effectiveness  to  he  used  operationally  with  the  Organizational  Assessment  Package  (OAP).  The  DAP 
is  primarily  an  attitudinal  survey  developed  for  use  by  the  Air  Force  Leadership  and  Management 
Development  Center.  Analyses  compared  job  enrichment  formulas  to  establish  the  most  predictive 
system  for  predicting  four  organizational  criteria.  Regression  equations  were  developed  for 
estimating  the  true  factor  scores  of  (LAP  factors.  This  provided  a  means  of  estimating  factor  scores 
from  a  small  sub-set  of  items,  therebv  reducing  the  number  of  survey  items  required  to  reliably 
establish  factor  score  measures.  Regression  equations  were  developed  using  variables  from  the  job 
and  supervisor  inventories  of  the  OAP  for  predicting  the  O  AP  criterion  inventories.  These  equations 
provide  estimates  of  criterion  scores  when  circumstances  prohibit  administration  of  the  entire  OAP 
and  the  criterion  inventories  have  been  excluded  to  shorten  OAP  length.  (58  pages) 


47  Lindholm,  EL,  Ruppel,  M.,  &  Buck  land,  G.H.  Attention  and  task  complexity  as  indicated  by 
physiological  indices.  AFHRL-TR- 79-47,  AD-  .4080  851.  Williams  AFB,  A Z:  Flying  Training  Division, 
December  1979.  Project  2313,  Contract  F33615-77-C-0069,  Arizona  State  University.  NTIS.  The 
objective  of  this  research  was  to  develop  physiological  measures  of  pilot  attention  and  workload  for 
use  in  flight  simulation  research  studies.  In  later  studies,  these  physiological  measures  will  then  be 
used  in  conjunction  with  behavioral  measures  of  pilot  attention  and  task  difficulty  in  order  to 
optimally  structure  flight  simulation  training  programs  and  equipment.  This  research  employed  two 
common  behavioral  information  processing  tasks  in  order  to  study  four  physiological  variables, 
namely,  heart  rate,  skin  conductance,  eye  movement,  and  cortical  evoked  response,  as  measures  of 
attention  and  arousal.  Four  separate  information  processing  experiments  were  conducted  involving 
both  choice  reaction  time  and  letter  matching  tasks.  For  the  choice  reaction  time  tasks,  the  faster 
responses  were  in  general  associated  with  increased  measures  of  arousal  as  indicated  by  heart  rate, 
skin  conductance,  and  evoked  potential  amplitude.  There  was  no  general  arousal  effect  produced 
for  the  letter  matching  tasks;  however,  the  cortical  evoked  response  varied  systematically  and 
reliably  with  task  difficulty  and  reaction  time.  In  this  regard,  simple  derision  evoked  short  latency 
low  amplitude  brain  waves,  while  more  difficult  decisions  evoked  longer  latency,  higher  amplitude 
brain  waves.  Thus,  the  heart  rate  and  skin  conductance  measures  of  arousal  reflected,  in  a  gross 
sense,  the  degree  of  subject  involvement  in  the  task,  and  the  evoked  potential  components  varied 
reliably  with  task  difficulty  and  performance.  (34  pages) 

48  Micalizzi,  J.,  Coward,  R.C.,  *  Nelson,  W.H.  Simulator  training  effectiveness  as  a  function  of 
error  counts  on  the  F-I5A  flight  simulator  instructor  operator  station.  AFHRL-TR-79-48. 
AD-A081  074.  Williams  AFB,  AZ:  Flying  Training  Division,  December  1979.  Project  1123. 
NTIS.  Effective  simulator  training  is  an  important  factor  in  the  Air  Force's  overall  ability  to  train 
pilots.  A  major  problem  is  that  simulator  managers  tend  to  assume  that  their  machines  are  always 
optimally  designed  and  used.  In  addition,  investigators  find  it  difficult  to  evaluate  simulator 
training  in  quantitative  terms  while  working  in  an  operational  setting.  These  problems  reflect  the 
need  for  the  Air  Force  to  carefully  consider  current  and  future  simulator  designs  and  training 
programs.  This  study  was  designed  to  investigate  procedural  errors  made  at  the  F-15A  Simulator 
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Instructor/Operator  Station  (IOS)  bv  instructor  pilots  (IPs).  An  observer  recorded  the  number  of 
errors  and  the  lime  needed  to  eorreel  eaeh  error  during;  a  tv  pical  ‘Ml-minutc  session.  Questionnaires 
were  filled  out  by  f  F-I.i  aircraft  IPs  and  It)  F-L>  simulator  operators  indicating  their  respective 
simulator  experience.  Data  were  collected  during  aetuai  training  missions  to  determine  if  IP  errors 
seriously  detracted  from  training  time.  The  results  showed  that  the  average  number  of  errors  and 
average  error  time  bad  an  insignificant  impact  on  simulator  training.  The  number  ol  simulator 
sessions  flown  bv  each  IP  in  the  course  ol  the  present  study  was  identified  as  an  important  factor  in 
effective  simulator  training,  varying  inversely  with  error  counts.  However,  no  relationship  was 
found  between  total  IP  hours  and  average  error  count.  In  addition,  the  electronic  tactics  selected  bv 
the  IP  may  have  bad  an  effect  on  average  error  count.  Additional  research  is  needed  to  determine  if 
IOS  modification  will  increase  simulator  training  effectiveness.  (IK  pages) 


Mulligan.  J.F.  Logie  tree  troubleshooting  aids:  Organizational  and  intermediate  maintenance. 
•4FHHI.-TR-79-W.  AD-A079  777.  'ft  right -Patterson  AFB.  OH:  Advanced  Svstems  Division. 
Jauuarv  l^SO.  Project  171(1.  ('.outran  F.Tt(>l5-78-(.-0013.  Management  and  Technical 
Services  (onipauv.  NTIS.  This  report  provide,  a  draft  militarv  specification  for  use  in  the 
procurement  of  Logic  Tree  Troubleshooting  Aids  (L  I  T As).  Keren!  research  has  demonstrated  that 
the  use  of  I  TT  Vs  can  significantly  improve  the  efficienev  and  effectiveness  of  maintenance 
personnel  in  performing  troubleshooting  tasks.  The  use  of  I.TTAs  results  in  quicker  location  of 
faults  and  reduced  consumption  of  spare  parts.  However,  at  present  there  is  no  specification 
available  for  the  procurement  of  I.TTAs.  The  draft  specification  was  developed  to  fill  this  need. 

A  thorough  review  of  the  stale  of  the  art  in  preparing  and  using  LIT  As  was  made  to  provide  the 
basis  for  developing  the  draft  specification.  This  was  accomplished  bv  reviewing  available  literature 
and  then  conducting  extensive  interviews  with  government  and  industrv  personnel  with  experience 
in  developing,  using,  and  evaluating  I  TT  As.  The  results  of  the  interv  iews  wi  re  analyzed  to  prov  bli¬ 
the  basis  for  establishing  the  requirements  for  developing  I.TTAs.  The  goal  was  to  develop  a 
specification  which  establishes  basic  requirements  for  developing  I.TTAs  which  will  result  in 
improved  performance  while  .till  providing  enough  flexibility  to  be  suitable  lor  application  to  a 
wide  variety  of  applications. 

Tile  draft  specification  provides  specific  and  general  requirements  for  tile  development  of  I  l  f  As. 
These  include  requirements  lor  (a)  task  analysis,  (b)  development  ol  troubleshooting  procedures, 
(c)  development  of  checkout  procedures,  (d)  presentation  formats,  (e)  preliniinarv  information,  (f) 
supplemental  and  support  information  (wiring  diagrams,  theory  of  operation,  etc.),  (g)  varying 
levels  of  enrichment,  and  (It)  dual  level  presentation.  The  specification  is  suitable  for  use  in 
procuring  I.TTAs  for  use  with  all  tvpcs  of  equipment:  electrical,  electronic,  mechanical  pneumatic, 
bvdraulic.  optical  and  combinations  thereof.  It  is  suitable  for  procurement  of  I.TT  As  for  use  at  the 
intermediate  and  organizational  levels  of  maintenance.  The  specification  mav  also  be  used  for  the 
development  of  checkout  and  logic  tree  procedures  for  use  in  other  tvpes  of  manuals.  (I  l(>  pages) 


l.obel.  A.K..  H  Mulligan.  J.T.  Maintenance  task  identification  and  uualvsis:  Organizational  anti 
intermediate  maintenance.  AFHKL-TH-79-50.  AD-A08.T  (>8.>.  Wright -Patterson  AFIl.  OH: 

Advanced  Systems  Division.  January  DI80,  Project  1710.  Contract  F3.'H*li»-78-C-OOI.'». 
Management  and  Technical  Services  ( ompanv .  NTIS.  This  report  provides  a  draft  militarv 
specification  for  use  by  Air  force  ami  other  DoD  agencies  in  specilving  the  requirements  lor 
maintenance  task  identification  and  analysis  (M  IT. A  A),  Several  new  tvpes  of  technical  data,  such  as 
job  guide  manuals  (Jt.Ms)  and  logic  tree  troubleshooting  aids  (I.TTAs).  have  been  adopted  for  use 
by  tile  Air  force.  I  he  development  of  accurate  and  effective  JO  Ms  and  I.TTAs  requires  that  a 
thorough  M  I  LA  A  fie  accomplished  to  prepare  the  data  base  from  which  JOMs  and  I.TTAs  are 


developed.  At  present  there  is  no  suitable  specification  available  to  establish  MTI&A  requirements 
for  use  in  procuring  JGMs  and  LTTAs.  The  draft  specification  was  developed  to  fill  this  need. 

A  thorough  review  of  the  state-of-the-art  in  performing  the  MTI&A  was  accomplished  to  provide  the 
basis  for  developing  the  draft  specification.  This  was  accomplished  bv  first  reviewing  the  literature 
in  the  area  and  then  conducting  extensive  interviews  with  government  and  indtistrv  personnel  who 
are  knowledgeable  of  and  experienced  in  current  MTI&A  procedures.  Interviews  were  conducted 
with  industry  personnel  who  have  had  experience  in  conducting  research  to  develop  MTI&A 
procedures,  and  with  personnel  who  have  had  experience  in  managing  and  conducting  MTI&A 
programs.  Interviews  were  also  conducted  with  Air  Force  and  Armv  personnel  who  have  had 
experience  in  procuring  MTI&A  based  technical  data.  The  results  of  the  literature  review  and 
interviews  were  analyzed  and  used  to  provide  the  basis  for  developing  the  MTI&A  requirements 
included  in  the  specification. 

The  draft  specification  requires  that  the  contractor  accomplish  specific  tasks  to  insure  that  all 
required  maintenance  tasks  are  identified  anti  that  all  information  required  to  prepare  effective 
J<»Ms  and  I.TTAs  is  developed.  The  tasks  include  the  development  of  (a)  a  task  identification  matrix 
to  identifv  all  required  tasks  and  specify  the  level  of  maintenance  (intermediate,  organizational, 
depot)  at  which  they  are  to  he  performed,  (b)  a  description  of  the  intended  user  (abilities,  training 
experience),  (c)  listings  ol  required  support  equipment  and  special  tools,  (d)  guidelines  for 
determining  the  level  of  detail  to  be  included  in  JO  Ms  and  I.TTAs.  (e)  an  analysis  of  possible 
equipment  faults  and  resulting  symptoms,  (f)  effective  step-bv-step  procedures  for  accomplishing 
each  task,  and  (g)  action  trees  outlining  a  trouble-hooting  strategy  to  isolate  each  possible  fault.  \ 
special  section  is  provided  for  accomplishing  the  MTI&A  for  systems  for  which  Logistic  Support 
Analysis  data  are  available.  The  draft  specification  is  suitable  for  the  procurement  of  MTI&A  for 
organizational  and  intermediate  levels  of  maintenance.  The  specification  establishes  firm 
requirements  tor  conducting  the  MTI&A  but  allows  the  contractor  considerable  freedom  in  how  he 
accomplishes  the  analysis.  The  specification  may  be  used  to  procure  MTI&A  for  the  development  of 
a  data  base  for  use  in  developing  other  types  of  manuals.  (124  pages) 


51  Martin,  E.L.  Training  effectiveness  of  platform  motion:  Review  of  motion  research  involving 
the  advanced  simulator  for  pilot  (raining  and  the  simulator  for  air-to-air  combat.  AFHRL-TR- 
79-51,  AD-A095  9.40.  Williams  AFB.  AZ:  Operations  Training  Division,  February  1981. 
Project  1124.  NTIS.  This  report  presents  a  summarv  review  of  the  transfer-of-training  studies 
conducted  by  the  Operations  Training  Division  of  the  Air  Force  Human  Resources  Laboratory 
investigating  the  training  ellecliveness  ol  six-degrees-of-freedom  platform  motion  cueing.  A  total  of 
six  studies  are  reviewed.  Ol  the  six  studies,  live  were  conducted  on  the  Advanced  Simulator  for  Pilot 
Training  (ASPT)  located  at  Williams  \FR  and  one  on  the  Simulator  for  Vir-to-Air  (lombat  (S  A  At') 
located  at  l.uke  \FB.  (asks  investigated  included  basic  and  advanced  contact,  instruments,  basic 
fighter  maneuvers,  and  conventional  weapons  delivery.  The  review  of  each  study  contains  a 
statement  of  objectives,  a  summarv  of  the  method  and  results,  a  data  exrerpt  representative  of  the 
findings,  and  a  critique.  The  report  also  contains  a  description  of  the  research  strategy  from  which 
the  studies  were  derived,  a  discussion  of  transfer-of-training  methodology,  and  a  discussion  of  the 
relationship  between  the  results  of  these  six  studies  and  research  findings  from  other  agencies  or 
facilities.  Implications  for  future  research  are  discussed.  (42  pages) 


52  Hughes,  R.(i„  Hannan,  S.T..  &  Jones,  W.E.  Application  of  flight  simulator  record/ playback 
feature.  AFHRL-TR-79-52,  AD-A081  752.  Williams  AFB,  AZ:  Flying  Training  Division, 
December  1979.  Project  1123.  NTIS.  1  ndergraduate  Pilot  Training  (LPT)  students  acquired  a 
complex  visual  flying  task  in  ASPT  under  one  of  three  instructional  conditions  which  differed  in 
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their  list'  of  an  automated  record/ [day hack  feature.  The  study  evaluated  differences  in  performance 
resulting  from  (a)  periodic,  repeated  use  of  a  recorded,  instructor-presented  demonstration.  0>) 
periodic  use  of  a  replay  of  student  performance,  and  (e)  use  of  equivalent  training  time  for 
additional  practice. 

The  data  indicated  little  or  no  instructional  value  associated  with  repeated  exposures  to  the  original 
demonstration  of  the  task  to  he  learned.  While  the  "replay’"  condition  produced  terminal 
performance  with  fewer  errors  on  the  average  than  the  "demo"  condition,  differences  between 
"practice"  and  "replay"  groups  were  not  statistically  significant.  The  surprising  finding  of  the 
study  was  the  effectiveness  of  simple  practice  relative  to  that  of  the  two.  so-called,  "instructional" 
conditions.  These  data  would  suggest  that,  at  least  in  some  instances,  a  training  approach  that 
provided  only  for  basic  performance  leedhack  (e.g..  a  "score")  might  be  equallv  as  effective  as  one 
with  provision  for  presenting  repealed  access  to  recorded  demonstrations  and/or  replays  of  previous 
performance.  (10  pages) 

53  Mullins.  C.J.,  Karles,  J.  A..  &  Wilbouru.  J.M.  Calculation  of  predictor  composites  in  the  absence 
of  a  criterion.  AFHRL-TR-79-53.  AD-A080  921.  Brooks  AFB.  TX:  Personnel  Research 
Division.  December  1979.  Project  2313.  NT1S.  Sometimes  a  prediction  battery  is  needed  for  a 
specialty  in  which  no  adequate  criterion  is  obtainable  within  a  reasonable  period  of  time.  This  is  the 
second  study  into  two  techniques  for  producing  a  criterion  sy  nthetically  .  One  technique  (called  R- 
Teehnique)  involves  the  rating  by  experts  of  100  profiles  showing  all  the  predictor  variables  under 
consideration.  Another  (the  M-Teehnique)  involves  the  rating  of  factors  bv  the  same  experts.  In 
both  instances,  the  sy  nthetic  criterion  data  are  used  to  produce  weights  for  the  predictors.  In  order  to 
check  the  efficiency  of  the  prediction  composites  emerging  from  the  use  of  the  sy  nthetic  criteria, 
they  are  compared  with  a  cross-validated  composite  obtained  in  the  usual  manner.  Synthetic 
composites  in  the  earlier  study  were  predicted  as  well  as  the  empirical  composite;  however,  in  this 
study,  the  results  were  much  poorer.  There  arc  differences  in  predictive  efficiency  across  the  four 
technical  schools  studied,  across  the  three  sets  of  predictor  variables  used,  and  across  the  kinds  of 
experts  used  (psychologists,  instructors,  anil  adminstrativc  airmen).  There  are  also  differences  in 
efficiency  associated  with  the  size  of  the  expert  groups,  with  larger  groups  producing  more  effective 
composites.  (.18  pages) 

.lit  1. (toper.  1,.  1 .,  &  Beswick,  (..A.  Recruiting  resource  and  goal  allocation  derision  model. 
Af  HRL-  rK-79-.j.j.  AD-A080  i  17.  Brooks  AFB.  IX:  Occupation  and  Manpower  Research 
Division.  January  1980.  Project  2077.  !\TIS.  This  report  presents  an  attempt  to  construct  a 
mathematical  model  that  could  he  used  to  allocate  Air  f  orce  recruiter  effort  based  on  recruiting 
organization  and  demographic  data  available  at  the  Air  force  Recruiting  Office  level.  Such  a  model 
based  on  a  non-linear  market  response  function  and  a  dynamic  programming  allocation  routine  was 
developed  and  tested  with  actual  Air  force  data.  I  he  model  was  one  already  formulated  and  tested 
in  a  sales  force  marketing  environment.  With  the  aid  of  the  model  designer,  it  was  modified  to  meet 
Air  force  Recruiting  Service  needs  and  data  availability.  The  model  has  been  further  modified  to 
include  several  Recruiting  Service  organizational  requirements,  \alidalion  of  the  model  against 
ai  tual  Recruiting  Service  allocation  decisions  was  perlormed  and  model  resource  allocations  were 
elos"  to  management  decisions.  Suggestions  as  to  management  use  of  the  model  in  forecasting  and 
recruiter  productivity  are  also  made  in  the  report.  (I  I  pages) 

•».i  Marlin.  K.l...  *  Calaneo.  D.F.  Computer  generated  image:  Relative  training  effectiveness  of  day 
versus  night  visual  scenes.  AFHRL-TR-79-56.  AD-A088  313.  Williams  AFB,  A/:  Operations 
Training  Division.  July  1980.  Project  1123.  XT1S.  \  transfer-of-lraining  design  was  used  to 


compare  the  relative  (raining  elfeclivcncss  of  (lay  ami  night  visual  scenes  lor  the  acquisition  of 
takeoff  and  landing  skills  in  the  novice  pilot  in  daviight  flight  conditions.  Twcntv-four 
undergraduate  pilot  trainees  with  no  previous  jet  piloting  experience  were  randomlv  assigned  to  one 
of  the  three  treatment  groups  (n  =  8):  Day.  Night,  and  ('.ontrol.  Those  students  assigned  to  the 
Control  group  received  the  standard  sy  llabus  of  preflight  and  flighlline  instruction.  The  students  in 
the  two  experimental  groups  received  three  sorties  in  the  Advanced  Simulator  for  Pilot  Training 
(ASPT)  covering  instruction  of  takeoff,  straight-in  approach  and  landing,  and  straight-in  approach 
to  a  touch-and-go.  ASPT  trained  students  received  the  same  amount  of  training  on  each  task  with 
performance  evaluated  periodically  with  the  ASPT's  automated  performance  measurement  svslcm 
(APM).  as  well  as  with  performance  ratings  supplied  bv  the  instructor  pilot  (IP).  The  onlv 
difference  in  training  conditions  was  the  use  of  either  a  dav  or  night  runwav  environment  visual 
scene.  The  field  o(  view  of  the  visual  displav  was  limited  bv  a  computer  mask  to  18°  horizontal  h\ 
36°  vertical,  hollowing  completion  of  the  ASPT  training,  the  students  advanced  to  the  flighlline  for 
T-37  instruction.  Transfer-of-training  evaluation  data  were  collected  by  the  student's  IP  on  the 
second  and  fifth  T-.17  missions.  All  IPs  had  received  thorough  pretraining  in  the  ASPT  on  the  data 
collection  procedures.  The  data  protocol  called  for  at  least  one  repetition  of  each  of  the  three  tasks  on 
each  flight.  The  IP  was  to  record  specific  aircraft  svslcm  states  of  various  task  segments  as  well  as 
provide  overall  task  proficiency  grades.  The  findings  of  the  study  are  as  follows,  (a)  There  were  no 
overall  differences  between  the  Day  and  Night  groups  in  their  simulator  performance,  although 
there  was  a  transitory  superiority  of  the  Dax  group  on  control  of  glidepath  descent  angle,  (b)  There 
were  no  differences  between  the  Dav  and  Night  groups  in  their  performance  in  the  aircraft,  (c)  The 
two  experimental  groups  performed  reliably  better  than  the  Control  group  on  the  Takeoff  task.  The 
results  of  this  study,  when  integrated  with  the  findings  of  other  relevant  research,  indicate  that 
w  hile  positive  transfer  of  training  to  day  light  flight  can  he  expected  with  the  use  of  either  a  day  or 
night  computer-generated  display,  simulator  training  should  he  more  extensive  than  used  in  the 
present  study  and  followup  data  on  student  performance  should  be  collected.  \  more  extensive 
transfer-of-training  study  should  he  conducted  within  the  context  of  the  l  udergraduate  Pilot 
Training  T-37  training  program,  comparing  a  night  scene  with  the  TV  model  board  system  currently 
in  use  on  the  Instrument  Flight  Simulator,  (.'l  l  pages) 


56  Fuller,  J.H..  Waag.  W.L..  &  Martin.  E.L.  Advanced  simulator  for  pilot  training:  Design  of 
automated  performance  measurement  system.  AFHRL-TR-79-57.  AD-A088  855.  Williams 
AFB,  AZ:  Operations  Training  Division.  August  1980.  Project  1 123.  NTIS.  The  objective  of  ibis 
effort  was  to  design  and  implement  an  automated  performance  measurement  (APM)  system  in  the 
\dvanecd  Simulator  for  Pilot  Training  (ASPT).  This  report  documents  that  development  effort  and 
describes  the  current  status  of  the  measurement  system.  It  was  assumed  that  superior  flying 
performance  in  the  aircraft  or  the  simulator  has  several  characteristics  which  are  reflected  by 
available  flight  parameters.  These  include  (a)  maintaining  certain  aircraft  state  parameters,  such  as 
airspeed  or  altitude,  close  to  some  defined  criterion  value,  (b)  avoiding  excessive  rates  and 
acceleration  forces  so  that  the  maneuver  is  executed  smoothly,  (c)  accomplishing  these  objectives 
with  the  least  amount  of  effort:  that  is.  by  minimizing  control  inputs,  and  (d)  not  exceeding 
procedural  or  safety  limits  established  for  the  maneuver.  To  date,  the  following  scenarios  have  been 
implemented  on  the  ASPT:  (a)  Transition  Tasks  —  Straight  and  Level.  Airspeed  Changes.  Turns. 
C.limbs/Deseents;  (b)  Takeoff/Approach/Landing  Tasks  —  Takeoffs.  Tech  Order  Climbs.  Slow 
Flight.  Configuration  Changes.  Straight-in  Approaches.  Overhead  Patterns.  Touch-and-Co's:  (c) 
Instrument  Tasks  —  Rate  Climbs/Descents.  Vertical  S-A.  Vertical  S-D.  GCA.  Proceed  Direct  to 
VOR;  (d)  Aerobatics  —  Aileron  Rolls.  Barrel  Roll.  Loop.  Split  S.  Cloverleaf.  Cuban  8.  Lazy  8:  and 
(e)  Formation  —  Fingertip.  This  measurement  capability  has  been  subsequently  utilized  in 
numerous  training  research  studies.  The  generalizahility  of  the  measurement  approach  has  been 
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demonstrated  in  recent  modifications  of  many  of  the  scenarios  for  use  liv  the  ASPT  in  an  A- 10 
aircraft  configuration.  Such  generality  points  to  the  possibility  of  developing  standardized 
measurement  scenarios  applicable  to  a  wide  variety  of  aircraft  and  simulator  types.  (70  pages) 

57  Albert,  W.G.  Predicting  involuntarv  separation  of  enlisted  personnel.  AFHRL-TR-79-58,  AD- 
A082  095.  Brooks  AFB.  TX:  Computational  Srieni  .  Division.  January  1980.  Project  6325. 
INTIS.  This  report  contains  the  results  of  a  study  to  compare  the  classification  accuracy  of  the 
Motivational  Attrition  Prediction  (MAP)  method  to  the  classification  accuracy  of  other  statistical 
algorithms  capable  of  i/mlicling  involuntarv  separation  within  the  Air  Force  enlisted  force.  The 
MAP  computer  program,  which  was  implemented  on  the  (  MV  AC  1 108  computer  system  at  the  Air 
Force  Human  Resources  Laboratory.  was  modified  to  increase  its  data-handling  and  computational 
capabilities  and  was  thoroughly  tested.  This  report  includes  a  description  of  the  computerized 
statistical  algorithms,  suhsample  selection  from  the  first-term  airman  population,  independent  and 
dependent  variables,  model  formulation  and  analvsis.  comparison  of  required  computer  resources, 
and  related  research  efforts.  (36  pages) 

58  Ausburn,  F.B.,  Ausburn,  L.J.,  &  Ragan,  T.J.  Task  analysis  schema  based  on  cognitive  style  and 
supplantational  instructional  design  with  application  to  an  Air  Force  training  course.  AFHRL- 
TR-79-59,  AD- A 082  312.  Lowry  AFB,  CO:  Technical  Training  Division,  February  1980. 
Project  2313,  Contract  F33615-77-C-0047.  I  niversity  of  Oklahoma.  NT1S.  The  primary  goal  of 
this  study  was  to  develop  a  schema  for  learning  task  analy  sis  and  the  design  of  instruction  in  which 
the  cognitive  style  of  learners  is  a  major  contributing  variable.  By  identifying  the  functions  a  task 
retpiires.  it  can  he  determined  which  cognitive  styles  are  likely  to  be  incompatible  with  the  task 
Instruction  can  then  be  designed  which  provides  necessary  assistance  through  supplanlation.  which 
is  defined  as  either  altering  the  task  requirement  to  better  suit  tin-  capabilities  of  the  learner  of 
performing  the  function  for  learners  which  they  are  unable  to  perform  for  themselves.  A  task 
analysis  schema  was  produced  which  identified  (a)  classes  or  types  of  learning  tasks  related  to 
cognitive  style,  (h)  specific  cognitive  styles  related  to  each  class  of  task,  and  (c)  instructional 
techniques  recommended  lor  each  class  of  task  in  order  to  deal  with  cognitive  style  problems.  The 
schema  was  applied  to  the  tasks  specified  in  the  objectives  of  an  Air  Force  training  course.  The 
VI  capons  Mechanic  Course  was  analyzed  using  the  proposed  schema  to  demonstrate  that  it  was 
particularly  workable  and  was  also  well  founded  theoretically .  The  schema  was  found  to  be  relevant 
to  many  of  the  course  objectives  and  to  generate  recommendations  for  effective  instruction.  (70 
pages) 


59  hngler,  ILL .,  Davenport,  K.l...  (>reen,  J„  A  Sears,  W  .K.,  111.  Human  operator  control  strategy 
model.  AFHRL-TH-79-60.  AD-A08J.  695.  M righl-Pallerson  AF’B,  OH:  Advanced  Systems 
Division.  April  1980.  Project  2313,  Contract  F3361 5-77-C-0042,  Georgia  Institute  of 
lev'll  oology .  INTIS.  Present  measures  ol  performance  during  training  are  inadequate  for  sensitively 
describing  cue  utilization,  for  assessing  individual  differences,  and  for  predicting  transfer  of 
training  to  other  tasks.  I  he  present  research  attempted  to  approach  this  problem  by  developing  a 
computer  simulation  of  continuous  motor  control  learning,  including  a  representation  of  control 
strategy,  and  applying  the  simulation  to  measurement  of  human  control  strategy.  Initial 
demonstration  and  validation  tests  indicate  that  the  simulation  is  able  to  identify  aspeets  of  human 
control  strategy,  ami  that  such  identification  may  provide  a  more  sensitive  measure  of  performanec. 
( I  Ml  pages) 


60  Davis,  J.D.,  Carson,  S.B.,  &  Reed,  W.R.  Feasibility  of  computer  applications  to  mission- 
oriented  training  in  the  aircraft  armament  systems  specialist  career  field.  AFHRL-TR-79-61, 
AD-A081  446.  Lowry  AFB,  CO:  Technical  Training  Division,  January  1980.  Project  1121, 
Contract  F33615-78-C-0052,  John  Davis  Associates.  NTIS.  A  survey  was  conducted  of  base- 
level,  mission-oriented  training  of  Aircraft  Armament  Systems  Specialists  (AFSC  46230)  upgrading 
to  the  5-skill  level  at  3  Tactical  Air  Command  bases.  Functions  performed  by  Air  Force  personnel  in 
support  of  such  training  were  analyzed,  as  was  the  training  itself,  to  determine  the  feasibility  of 
applying  state-of-the-art  computer  technology  to  the  problems  of  management  and  administration 
of  the  training.  Five  computer-supportable  functions  were  identified  and  rank-ordered  by  the 
degree  to  which  they  could,  if  automated,  provide  increases  in  training  effectiveness  and  efficiency. 
Several  specific  problems  related  to  OJT  and  the  upgrade  training  process  in  the  aircraft 
maintenance  production  environment  were  also  identified.  Recommendations  were  made  in  the 
areas  of  computer  support  of  base-level  training,  development  of  task-related  instructional 
materials,  and  standardization  of  training  and  training  requirements.  (136  pages) 


61  Kleinwaks,  J.M.  Advanced  Low  Cost  C-Cuing  System  (ALCOCS).  AFHRL-TR-79-62,  AD-A079 
809.  Wrighl-Patterson  AFB,  OH:  Advanced  Systems  Division,  January  1980.  Project  1958, 
Contract  F33615-76-C-0060,  Singer  Company.  NTIS.  The  C-seat  is  a  device  that  replicates  in  a 
flight  simulator  the  pilot/seat  interaction  due  to  aircraft  acceleration.  The  C-suil  and  seat  shaker 
systems  provide  important  cues  to  the  pilot  used  in  the  control  of  tile  aircraft.  These  cues  are 
believed  to  be  particularly  significant  in  high  performance  tactical  aircraft.  In  order  to  investigate 
G-euing  philosophies  and  drive  schemes,  a  system  was  developed  with  capabilities  exceeding  that  of 
present  C-etiing  systems,  which  will  allow  the  determination  of  how  to  obtain  the  maximum  benefit 
from  these  cuing  sources.  The  Advanced  Low  Cost  G-Cuing  System  (ALCOCS)  embodies  the  basic 
somatic  capabilities  of  the  first  generation  G-seat  coupled  with  high  response  speed  and  system 
flexibility.  ALCOCS  combines  G-seat.  C-suit.  and  seat  shaker  systems  into  one  integrated  G-cuing 
system.  (76  pages) 


62  Bailey,  J.,  Hughes,  R.G.,  &  Jones,  W.E,  Application  of  backward  chaining  to  air-to-surfare 
weapons  delivery  training.  AFHRL-TR-79-63,  AD-A085  610.  Williams  AFB,  AZ:  Flying 
Training  Division,  April  1980.  Project  1 123.  NTIS.  Kxperienced  pilots  acquired  a  30-degree  dive 
bombing  task  in  the  Advanced  Simulator  for  Pilot  Training  (ASPT).  Half  the  subjects  acquired  the 
task  under  a  "whole  task"  approach:  half  under  a  “backward  chaining”  approach.  Criterion 
performance  was  defined  in  terms  of  circular  bomb  error.  The  results  indicated  that  subjects  in  the 
backward  chaining  group  performed  significantly  better  than  subjects  in  the  whole  task  group  when 
training  time  for  the  two  groups  was  equated.  The  results  demonstrate  that  backward  chaining  mav 
be  used  to  significantly  enhance  the  effectiveness  of  simulator-based  instruction  on  a  sequential 
task  such  as  manual  dive  bombing.  The  results  provide  an  important  demonstration  of  the 
appropriateness  of  basic  learning  theory  principles  and  techniques  for  generating  effective 
instructional  approaches  utilizing  the  unique  capabilities  of  the  flight  simulator.  (26  pages) 


63  Gnclowski,  J.C.,  &  Baran,  H.A.  Digital  Avionics  Information  System  (DAIS):  Life  Cycle  (lost 
Impact  Modeling  System  (LCCIM)  —  A  managerial  overview.  AFHRL-TR-79-64,  AD-A093 
281.  'ftright-Patterson  AFB,  OH:  Logistics  and  Technical  Training  Division,  November  1980. 
Project  2051,  Contract  F336I5-75-C-52I8,  Dynamics  Research  Corporation.  NTIS.  This  report 
provides  an  overview  of  the  Life  Cycle  Cost  Impact  Modeling  System  (LCCIM).  The  I.CCIM  can  be 
used  to  assess  the  imparl  of  weapon  system  characteristics  on  sy  stem  support  resource  requirements 
and  life  cycle  cost  (LCC).  It  was  developed  to  enhance  present  Air  Force  capability  to  conduct  trade¬ 
offs  between  competing  design,  manpower,  and  logistics  alternatives  early  in  the  weapon  systems 
acquisition  process. 
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This  report  also  contains  a  general  description  of  the  initial  application  of  the  LCClM:  an  analysis  of 
the  potential  impacts  of  the  Digital  Avionics  Information  System  (DAIS)  concept  of  avionics 
integration  on  LCC  and  system  support  personnel  requirements.  References  are  provided  for  other 
related  reports  which:  describe  that  application,  document  the  development  of  ITI’IM  components, 
and  provide  user's  guide  information  and  computer  program  listings. 

The  basic  application  of  the  I.CCIM  modeling  svstcm  involves  four  steps:  (I)  perform  a  Functional 
Analysis  to  identify  existent  operational  equipment  which  can  functionally  satisfy  system 
requirements  and  establish  a  reference  list  of  comparable  equipment  in  the  DoD  inventory  for 
which  data  is  available:  (2)  perform  a  Maintenance  Analysis  to  determine  how  reference  values  for 
resource  utilization  parameters  should  he  modified  to  reflect  design,  manpower,  and  logistics 
concept  changes:  (3)  exercise  the  Training  Requirements  Analysis  Model  (TRAMOD)  component  of 
the  LCClM  to  determine  a  baseline  training  program  based  on  skill  and  knowledge  requirements: 
ami  (!)  exercise  the  Reliability  and  Maintainability  and  C.ost  Model  (RMCM)  component  of  the 
I.CCIM  to  aggregate  resource  utilization  and  then  compute  total  life  cycle  cost  estimates  for  use  in 
the  comparison  of  trade-oil  alternatives. 

Tile  I.CCIM  is  a  powerful  tool  for  determining  system  support  resource  requirements  as  well  a- 
conducting  I XX!  trade-off  analyses.  It  is  user-interactive  and  extremely  versatile:  operable  on  input 
data  at  varying  levels  of  detail  during  all  phases  of  tile  weapon  system  acquisition  process. 
Responsiveness  to  both  general  and  detailed  queries  encourages  more  trade-off  analyses  to  he 
conducted  early  in  the  design  process,  where  cost  avoidance  information  can  be  most  effectively 
acted  upon.  LCClM  data  processing  takes  into  account  the  inlcrai  lion  between  support  requirements 
and  cost  parameters.  Its  outputs  provide  increased  visibility  concerning  both  individual  and 
collective  impacts,  thus  affording  information  concerning  the  "why"  as  well  as  the  "what"  of  trade¬ 
off  analysis  results.  In  addition,  the  IXX.'IM  is  operable  at  the  system,  subsystem,  and  line- 
replaceable-unit  (I.Rl  )  level  of  equipment  indenture.  \s  such,  it  is  useful  in  the  evaluation  of 
discrete  impacts  and  in  the  identification  of  "high  drivers"  of  system  support  resource 
requirements.  ( |(t  pages) 


hi  Coclowski.  J.C..  (dasier.  J.M.,  Kistler.  R.H..  Bristol.  M.A..  A  Baran.  H.A.  Digital  Avionics 
Information  System  (DAIS):  Life  cycle  cost  impact  modeling  system  Reliability. 
.Maintainability,  and  Tost  Model  (RMCM)  —  Description  users  guide.  AFHRL-TR-79-65.  AD- 
.4089  0-15.  Wrighl-I’alterson  AFB.  OH:  Logistics  and  Technical  Training  Division.  August 
1980.  Project  2051.  Contract  F330 15-75-0-52 18.  Dynamics  Research  Corporation.  NTIS.  This 
technical  report  provides  guidance  to  the  users  of  the  Reliability.  Maintainability,  and  Cost  Model 
(RMCM).  This  report  contains  all  information  needed  for  users  to  interact  with  the  RMCM  computer 
program  from  a  computer  terminal. 

The  RMCM  and  the  Training  Requirements  Analysis  Model  (TRAMOD)  described  in  AFHRL-TR- 
78-. >8(||)  are  the  two  computer  programs  that  are  part  of  the  Life  Cycle  Cost  Impact  Model  (LC.CIM) 
modeling  system.  The  LCClM  can  be  used  to  assess  the  impact  of  weapon  system  characteristics  on 
human  resource  requirements  and  life  cycle  cost.  It  was  developed  to  provide  the  Air  Force  with  a 
better  in-house  capability  to  conduct  trade-offs  between  competing  design,  manpower,  and  logistics 
alternatives.  The  initial  application  of  LCClM  was  directed  at  determining  potential  impacts  of  the 
Digital  Avionics  Information  .System  (DAIS)  concept  on  system  support  |>ersonnol  requirements  and 
life  cycle  cost.  The  modeling  system  is.  however,  applicable  in  the  development  of  any  new  weapon 
system  or  the  modification  of  an  existing  weapon  system.  (See  \FHRL-TR-79-(>4  for  a  description  of 
LCCLM.) 
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The  RMCM  serves  as  a  powerful  tool  within  the  LCCIM  for  conducting  resource  requirements, 
costing,  and  trade-off  analyses.  User-oriented,  it  accepts  input  data  at  varying  levels  of  detail  during 
all  phases  of  the  weapon  system  acquisition  process.  Also,  the  speed  of  the  interactive  RMCM 
computer  program  will  encourage  more  trade-off  analyses  early  in  the  design  process,  where  cost 
avoidance  actions  are  most  effective.  The  RMCM  data  processing  takes  into  account  the  interaction 
between  support  requirements  and  cost  parameters.  Outputs  provide  for  the  increased  visibility  of 
cost  drivers  and  their  individual  and  combined  impacts  on  system  ownership. 

Included  in  this  Users  Guide  are  (a)  a  description  of  the  RMCM  functions  and  capabilities,  (b)  a 
description  of  each  cost  element  which  it  covers,  along  with  its  associated  equations,  (c)  instructions 
for  preparing  input  data  files,  (d)  a  description  of  the  input  data  format  for  the  cost  model  data 
bank,  (e)  an  explanation  of  the  interactive  procedures  to  be  used  on  the  computer  terminal,  and  (f) 
examples  of  the  RMCM  batch  mode  printed  outputs.  (170  pages) 


65  Goclowski,  J.C.,  LoFaso,  A.J.,  Peskoe,  S.E.,  &  Baran,  H.A.  Air  Force  personnel  availability 
analysis:  A  description  of  the  Personnel  Availability  Model  (PAM).  AFHRL-TR-79-66.  AD- 
A089  707.  Wright-Palterson  AFB,  OH:  Logistics  and  Technical  Training  Division,  September 
1980.  Project  1959,  Contract  F33615-77-C-0032,  Dynamics  Research  Corporation.  NTIS.  This 
is  the  first  of  three  technical  reports  describing  a  methodology  for  projecting  the  future  availability 
of  Air  Force  personnel  and  analyzing  the  potential  impacts  of  personnel  policy  changes.  Developed 
within  the  Air  Force  Human  Resources  Laboratory's  Project  1959.  "Advanced  System  for  the 
Human  Resources  Support  of  Weapon  System  Development."  the  methodology  will  provide  the  Air 
Force  with  an  increased  capability  for  considering  the  human  resources  requirements  of  weapon 
systems  in  terms  of  the  future  availability  of  personnel  needed  to  maintain  and  operate  the  systems, 
and  the  factors  which  determine  personnel  availability. 

The  report  documents  the  development  of  a  key  element  of  that  methodology —  a  computerized 
Personnel  Availability  Model  (PAM)  and  its  associated  data  bank.  Report  AFHRL-TR-79-67 
describes  application  techniques,  and  report  AFHR1.-TR-79-08  provides  a  program  description 
which  includes  an  applied  PAM  analysis  of  Air  Force  personnel. 

The  PAM  represents  career  transition  activity  within  the  Air  Force  by  a  series  of  Markov  processes, 
each  depicting  a  subpopulation  of  airmen  with  states  defined  by  year  of  service  and  pavgrade.  State 
transition  probabilities  are  calculated  on  the  basis  of  actual  transition  activity  data  contained  in  the 
l  niform  Airman  Record  (l  AR).  Subpopulations  may  be  defined  on  an  a  priori  basis  such  as  by  Air 
Force  Specialty  Code  (AFSC)  designation,  or  analytically  established  by  applying  a  discrete 
dependent  variable  regression  analysis  technique  called  Logit  Analysis.  This  technique,  described  in 
technical  report  AFHRL-TR-79-07.  identifies  subpopulations  of  personnel  with  similar  career 
transition  behavior  and  describes  them  in  terms  of  individual  attribute  data  contained  in  the  l  AR. 

Basically,  the  PAM  operates  on  l  AR  data  to  project  future  career  transition  arlivily  on  the  basis  of 
occurrences  in  the  past.  The  results  are  processed  to  yield  "snapshot"  descriptions  of  the  total  force 
composition  at  user  selected  intervals.  The  PAM  data  bank  presently  contains  a  selection  of  data 
elements  from  the  1975  and  1976  l  AR  files  for  approximately  95.000  airmen  assigned  to  13  AFSCs. 
(56  pages) 


66  Goclowski,  J.C.,  Peskoe,  S.E.,  LoFaso,  A.J.,  &  Baran,  H.A.  Air  Force  personnel  availability 
analysis:  Application  techniques  of  the  Personnel  Availability  Model  (PAM).  AFHRL-TR-79- 
67,  AD-A088  801.  Wright-Patterson  AFB,  OH:  Logistics  and  Technical  Training  Division, 
August  1980.  Project  1959,  Contract  F33615-77-C-0032,  Dynamics  Research  Corporation. 
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NTIS.  r».i>  is  llic  seeond  of  throe  toolmioal  reports  describing  a  methodology  for  projecting  the 
future  availability  of  Air  force  personnel  and  analyzing  the  potential  impacts  of  personnel  policy 
changes.  Developed  within  the  Air  force  Human  Resources  Laboratory  s  Project  1959.  “Advanced 
Svstom  for  the  Human  Resources  Support  of  Vi  capon  Sy  stem  Development,  the  methodology  will 
provide  the  Air  force  with  an  increased  capability  lor  considering  the  human  resources 
requirements  of  weapon  svstems  in  terms  of  (In-  future  availability  ol  personnel  lor  maintaining  and 
operating  the  sv  stems  and  the  factors  which  determine  their  availability. 

Technical  report  AFIIRL-TR-79-(><>  documents  the  development  of  the  methodology  for  a 
computerized  Personnel  Availahilitv  Model  (PAM)  and  its  associated  data  hank.  Ibis  report 
(AFHRL-TR-79-07)  describes  application  techniques  of  the  PAM.  Technical  report  AFHRL-TR-i9- 
(>8  provides  a  program  description  which  includes  an  applied  PAM  analysis  of  Air  force  personnel. 

The  PAM  represents  career  transition  activity  within  the  Air  force  according  to  a  series  ol  Markov 
processes,  f.ach  process  depicts  a  suhpopulalion  oi  airmen  with  slates  defined  by  year  of  service 
(VOS)  and  pavgradc.  The  PAM  uses  a  mathematical  Markov  model  to  project  future  personnel 
availahilitv  .  It  assumes  that,  in  respect  to  career  transition,  the  population  of  technical  personnel  is 
homogeneous  within  the  Air  force.  This  report  describes  the  results  of  the  effort  undertaken  to 
check  the  validilv  of  the  Markov  model  approach  to  Air  force  personnel  availability  analysis  and 
also  that  of  the  homogeneitv  assumption. 

Two  procedures  wen*  developed  as  part  ol  this  effort.  1  he  first  involves  the  identification  of 
personnel  attributes  which  may  impact  career  transition  rates  of  the  Air  force  technical  personnel. 
The  second  procedure  involves  accurate  projections  of  the  described  Air  force  technical  personnel 
suhpopulatious  if  impacting  personnel  attributes  are  identified. 

No  impacting  attributes  were  found  for  the  13  technical  Air  Force  Specialty  ('.odes  investigated. 
Thus,  the  validity  of  the  Markov  model  and  the  homogeneity  of  technical  personnel  are  accepted 
with  regard  to  career  transition.  In  addition,  two  byproducts  of  this  validation  effort  tend  to  widen 
the  range  of  PAM  application.  The  first  byproduct  indicated  that  the  procedures  developed  in  this 
effort  also  may  he  applied  to  nontechnical  Air  Force  personnel.  Thus,  the  PAM  also  may  be  used  to 
project  the  future  availability  of  all  Air  Force  personnel.  The  second  byproduct  stems  from  the 
statistical  techniques  used  in  this  effort.  It  indicated  that  one  of  the  statistical  techniques  is  useful 
for  modify  ing  transition  probabilities  based  on  expected  or  proposed  changes  in  Air  Force  personnel 
jtolicy.  (54  pages) 


67  (.oclowski.  J.(...  LoFaso,  A.J.,  Peskoe.  S.E..  &  Baran.  H.A.  Air  Force  personnel  availahilitv 
analysis:  Program  description  for  the  Personnel  Availability  Model  (PAM).  AFHRL-TR-79-68. 
AD-A088  800.  %  riglit-Patterson  AFB.  OH:  Logistics  and  Technical  Training  Division.  August 
1980.  Project  1959.  (  on tract  F3361 5-77-C-0032.  Dynamics  Research  Corporation.  NTIS.  This 
is  the  third  ol  three  technical  reports  describing  a  methodologv  for  projecting  the  future  availahilitv 
ol  \ir  force  personnel  ami  analyzing  the  potential  impacts  of  personnel  poliev  changes.  Developed 
within  the  Air  Force  Human  Resources  Laboratory  Project  1959.  “Advanced  System  for  the  Human 
Resources  Support  of  Weapon  System  Development."  (lie  methodologv  will  provide  tin*  Air  Force 
w  i  (It  an  increased  capability  lor  considering  and  determining  the  human  resources  requirements  of 
weapon  systems  in  terms  of  the  future  availahilitv  of  personnel. 
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Technical  report  AFHRL-TR-79-66  described  the  development  of  that  methodology  which  includes 
a  computerized  Personnel  Availability  Model  (PAM)  and  its  associated  data  bank.  Report  AFHRL- 
TR-79-67  described  application  techniques  to  improve  the  accuracy  of  the  PAM.  This  report 
(AFHRL-TR-79-68)  provides  a  description  of  the  computerized  PAM  programs  including  an 
applied  PAM  analysis  of  Air  Force  personnel.  (52  pages) 

68  Headquarters  Air  Force  Human  Resources  Laboratory.  Fiscal  Year  1981  —  Air  Force  technical 
objective  document.  AFHRL-TR-79-69,  AD-A080  628.  Brooks  AFB,  TX:  Headquarters  Air 
Force  Human  Resources  Laboratory.  March  1980.  (Covers  all  AFHRL  projects.)  NTIS.  This 
document  provides  the  academic  and  industrial  R&I)  community  with  a  summary  of  the  technical 
area  objectives  of  Air  Force  research  in  the  field  of  human  resources.  The  areas  covered  are:  (a) 
Personnel  and  Manpower  Management,  (h)  Education  and  Training,  (e)  Personnel  Selection  and 
Retention,  (d)  Force  Structure  and  Utilization.  (e)  Flying  Training  Technology,  (f)  Technical 
Training  Technology,  (g)  Simulation  Technology  for  Training,  and  (h)  Personnel  and  Training 
Factors  in  Advanced  Systems.  (20  pages) 

69  Ree,  M.J.,  &  Jensen,  H.E.  Item  characteristic  curve  parameters:  Effects  of  sample  size  on  linear 
equating.  AFHRL-TR-79-70,  AD-A082  341.  Brooks  AFB,  TX:  Personnel  Research  Division, 
February  1980.  Project  7719.  NTIS.  In  order  to  establish  large  item  pools,  it  is  necessary  to  try  out 
hundreds  of  items  for  possible  inclusion.  Because  it  is  impractical  to  administer  several  hundred 
items  to  several  thousand  people,  the  invariance  properties  of  Item  Characteristic  Curve  (ICC) 
parameters  are  used  to  advantage  to  equate  test  items.  A  simulation  study  was  conducted  in  order  to 
investigate  the  effects  of  errors  in  estimated  ICC  parameters  on  equaled  parameters.  Four  samples  of 
simulated  examinees,  ranging  from  250  to  2.0(H)  subjects,  were  administered  a  different  test 
containing  the  20  anchor  items,  (this  60  additional  items  on  the  same  scale.  The  effectiveness  of  the 
equating  procedures  was  studied  through  analysis  of  summed  absolute  deviations  from  the  known 
item  parameters  of  the  estimated  item  parameters  and  the  equated  item  parameters  for  the  various 
combinations  of  "anchor"  item  calibration  sample  size  and  equaling  same  size.  (16  pages) 

70  Donahue,  K.E.,  Medellin,  A.,  &  Loup,  K.  Bibliography:  Occupation  and  Manpower  Research 
Division,  Air  Force  Human  Resources  Laboratory  (1957—1979).  AFHRL-TR-79-71,  AD- 
A081  751.  Brooks  AFB,  TX:  Occupation  and  Manpower  Research  Division,  December  1979. 
Project  7734.  NTIS.  This  report  presents  a  bibliography  of  technical  reports  and  other  publications 
on  the  research  conducted  by  the  Occupation  and  Manpower  Research  Division.  Air  Force  Human 
Resources  Laboratory  over  the  period  July  1957  to  July  1979.  The  technical  reports  listed  in  this 
bibliography  are  obtainable  by  qualified  requestors  from  the  Defense  Technical  Information 
Center.  (48  pages) 

71  Waag,  W.L.  Training  effectiveness  of  visual  and  motion  simulation.  AFHRL-TR-79-72,  AD- 
A094  530.  Williams  AFB,  AZ:  Operations  Training  Division,  January  1981.  Project  1123. 
NTIS.  A  review  of  the  literature  concerning  the  training  effectiveness  of  visual  and  motion 
simulation  is  presented  in  this  report.  Although  there  exist  much  pilot  opinion  and  in-simulator 
performance  data,  their  extrapolation  to  training  effectiveness  information  is  questioned.  The 
present  review  focuses  on  data  obtained  through  the  application  of  the  transfer-of-training 
methodology.  The  results  are  discussed  in  terms  of  study  design  factors,  and  recommendations  are 
made  wherein  additional  research  data  are  needed.  (30  pages) 


72  Finstuen.  K..  &  Edwards.  J.O.  Jr.  Longitudinal  effects  of  job  change  upon  intcrcsl,  utilization 
and  satisfaction  altitudes.  AFHRL-TR-79-73.  AD-A091  753.  Brooks  AFB.  TX:  Manpower  and 
Personnel  Division.  October  1980.  Project  7734.  INTIS.  This  research  was  designed  to  identify 
and  assess  the  effects  of  a  job's  context  and  naturally  occurring  job  content  changes  upon  the  jolt 
attitudes  of  709  \ ir  Force  radio  operators  (career  field  2*13X3).  This  investigation  consisted  of  two 
phases.  The  first  phase  concentrated  upon  identifying  specific  joh  types  within  the  radio  operator 
career  field  at  two  points  in  time,  and  determining  the  flow  of  personnel  front  one  jolt  type  to 
another  over  a  I  7-ntonlh  period.  Fight  specific  joh  t\  pes  along  with  associated  task  and  joh  changes 
are  discussed.  In  the  second  phase,  a  series  ol  multiple  linear  regression  analyses  were  employed  in 
the  prediction  ol  joh  altitude  criteria  consisting  of  perceived  joh  interest,  fell  utilization  of  talents 
and  training,  and  overall  satisfaction.  Results  indicated  that  indiv  iilual  inputs  such  as  mouths  on  the 
jolt  (MOJ)  and  total  active  Federal  military  service  time  contributed  significantly  in  predicting  joh 
interest  and  felt  utilization:  and  M<  1.1.  aptitude  and  grade  contributed  to  the  prediction  ol  ov orall  joh 
satisfaction.  In  addition,  situational  inputs  such  as  number  of  tasks  performed  and  average  task 
difficulty  measures  substantially  improved  prediction  of  attitudes.  Prediction  id  satisfaction  criteria 
hv  job  types  identified  in  phase  one  of  this  study  revealed  that  interest  and  overall  satisfaction 
tended  to  lie  more  highly  associated  with  an  individual's  current  joh  while  fell  iilili/.aliou  tended  to 
he  associated  with  both  the  individual  '  current  and  past  job  experiences.  The  test  of  a  filial  model 
incorporating  indiv  iilual  and  situational  inputs  as  well  as  job  type  or  group  membership  information 
revealed  that  even  when  controlling  for  radio  operator  and  task  characteristics,  group  data  in  the 
form  of  job  types  contributed  significantly  to  all  satisfaction  altitude  measures.  Implications  for  joh 
satisfaction  predictions  include  improving  job  perceptions  through  personnel,  task,  and  duty 
assignment  policies  as  an  approach  to  joh  enrichment.  (103  pages) 

73  Lewis.  W.E.,  Lovelace,  D.E.,  Mahany,  R.W.,  &  Judd.  W.A.  Computer-assisted  instruction  in  the 
context  of  the  advanced  instructional  system:  Materials  development  procedures  and  system 
evaluation.  AFHRL-TR-79-74,  AD-A082  996.  Lowry  AFB.  CO:  Technical  Training  Division. 
March  1980.  Project  ILIR,  Contract  F33615-78-C-0023.  McDonnell  Douglas  Astronautics 
Company  —  St.  Louis.  INTIS.  This  report  details  the  second  of  a  two  p3rt  project  to  design,  develop, 
implement,  and  evaluate  an  authoring  system  which  would  provide  a  basis  for  the  cost  effective 
production  of  computer-assisted  instruction  (CAI)  materials.  It  addresses  the  definition  of  a 
procedural  model  for  CAI  development,  development  of  a  CM  Authoring  Procedures  Handbook, 
and  evaluation  of  the  complete  authoring  system.  The  procedural  model  consists  of  six  major 
components:  selection  of  target  content,  development  of  CAI  materials,  formative  evaluation, 
definition  and  evaluation  of  student  assignment  rules,  stimulative  evaluation,  and  on-going 
evaluation.  The  Authoring  Procedures  Handbook  describes  the  authoring  procedures  model  and 
provides  detailed  instruction  on  use  of  the  software  tools.  Evaluation  of  the  system  documents  a 
substantia)  reduction  in  materials  development  time  over  that  of  conventional  approaches. 
Additionally,  the  materials  developed  reduced  average:  lesson  and  objective  failure  rail's,  first 
attempt  study  time,  lesson  and  objective  failure  rates,  first  attempt  study  time,  lesson  time  to 
criterion,  end-of-block  objective  failure  rates,  and  end-of-block  lest  objective  failure  rates  as 
compared  to  non-CAI  approaches.  (82  pages) 


71  Deignan,  C.M..  Seager.  B.R.,  Kimball.  M..  H  Horowitz.  N.S.  Computer-assisted,  programmed 
text,  and  lecture  modes  of  instruction  in  three  medical  training  courses:  Comparative 
evaluation.  AFIIRL- 1  R-79-76.  AD- 4085  609.  Lowrv  AFB.  CO:  Icclvivieal  Training  Division. 
June  1980.  Project  1121.  MIS.  I  lie  present  study  ol  .(Ml  medical  trainees  in  three  dillcrcut 
career  Holds  was  conducted  to  reduce  the  data  gap  in  medical  training  on  the  following  major 
(pie-lion':  (a)  Do  compolcr-U'sistcd  instruction,  programmed  text,  and  lecture  differ  in 


32 


instructional  effectiveness?  (b)  Do  Learners  who  differ  in  characteristics  (e.g..  aptitude  and 
motivation)  achieve  more  in  less  time  under  computer-assisted  instruction,  programmed  text,  or 
lecture?  Computer-assisted  instruction  was  demonstrated  to  be  more  effective  in  less  time  than 
programmed  text  or  lecture;  however,  aptitude,  course,  and  learner  characteristics  interacted  with 
achievement  and  time  criteria.  Learner  characteristics  profiles  of  high-fast  and  low-slow  achievers 
in  each  condition  were  provided  to  facilitate  decisions  about  alternative  instructional  assignments. 
(34  pages) 


75  Nix,  C.J.,  Tate,  T.,  Dutka,  S.C.,  Montgomery,  H.L.,  Showers,  D.P.,  Klein,  T.G.,  &  Marshall, 
A.P.  Low-cost  technical  alternative  for  learning  center  managers.  AFHRL-TR-79-77,  AD- 
A082  343.  Lowry  AFB,  CO:  Technical  Training  Division,  February  1980.  Project  1J21, 
Contract  F33615-78-C-0037,  McDonnell  Douglas  Astronautics  Companv — St.  Louis.  NTIS. 
This  study  established  the  feasibility  of  replacing  high  performance  and  relatively  expensive 
terminals  with  less  expensive  ones  adequate  for  supporting  specific  tasks  of  Advanced  Instructional 
System  (A1S)  at  Lowry  AFB.  Colorado.  Surveys  of  user  requirements  and  available  devices  were 
conducted  and  the  results  used  in  a  system  analysis.  The  results  of  the  analysis  formed  the  basis  for 
determining  the  detailed  hardware  requirements  and  subsequent  hardware  selection,  procurement 
and  installation.  Additionally,  the  software  modifications  necessary  to  accommodate  the  new 
hardware  were  made  and  the  resultant  total  system  was  evaluated  in  an  operational  training 
environment.  (24  pages) 

76  Headquarters  Air  Force  Human  Resources  Laboratory.  19th  annual  conference  of  the  Militarv 
Testing  Association.  AFHRL-TR-79-78.  AD-A077  347.  Brooks  AFB.  TX:  Headquarters  Air 
Force  Human  Resources  Laboratory.  November  1979.  Projects  7734  and  7719.  NTIS.  The 
Military  Testing  Association  Conference  was  held  17-21  October  1977  at  the  El  Tropieano  Hotel. 
.San  Antonio,  lexas.  It  was  hosted  by  the  Air  Force  Human  Resources  Laboratory.  Independent 
presentations  were  made  by  members  of  the  Department  of  Defense.  I  nited  Stales  Coast  Guard,  and 
related  Defense  contractors.  The  text  of  each  presentation  has  been  included  in  this  report.  (1.158 
pages) 


77  Sauer,  D.W.,  Deem,  R.N.,  &  Askren,  W.B.  Expert  estimate  method  of  generating  maintenance 
and  manpower  data  for  proposed  Air  Force  systems:  Evaluation.  AFHRL-TR-79-79,  AD-A082 
994.  Wright-Patter8on  AFB,  OH:  Advanced  Systems  Division,  March  1980.  Project  1124. 
Contract  F33615-77-C-0060,  Systems  Research  Laboratories.  Incorporated.  NTIS.  The 
objectives  of  this  study  were  to  exercise  an  expert  estimate  method  of  generating  maintenance  and 
manpower  data  for  new  systems,  to  determine  the  accuracy  of  the  estimated  data,  to  evaluate  a 
prototype  guide  describing  the  expert  estimate  method,  to  collect  cost  data  for  implementing  the 
method,  and  to  prepare  a  users  manual  for  the  expert  estimate  method.  Seventy  Air  Force 
technicians  having  one  of  three  ground  radar  Air  Force  Specialty  Codes  participated  as  expert 
estimators.  These  technicians  estimated  r.aintenance.  manpower,  and  training  requirements  for  a 
new  operational  ground  radar  vtU  .i.  i’he  estimators  had  no  experience  on  the  radar  system  and 
used  only  an  early  design  phase  engineering  description  of  the  system  as  the  basis  for  their 
estimates.  The  accuracy  of  the  estimated  data  was  determined  by  comparing  the  estimates  with  the 
operational  data  collected  on  the  radar  system.  Results  indicate  that  technicians  can  estimate 
maintenance  task  lime,  crew  size,  skill  level,  career  field/AFSC  requirements,  and  training  times 
with  acceptable  levels  of  accuracy.  The  method  also  produced  derived  person-hour  estimates. 
Estimates  of  support  equipment  requirements,  the  distribution  of  maintenance  tasks,  and  derived 
person-hours  for  troubleshooting  and  specific  off-equipment  maintenance  tasks  were  not  accurately- 
estimated.  The  prototype  users  guide  recommendations  were  generally  supported  in  the  areas  of 
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engineering  description  package  and  questionnaire  preparation,  qualification*  of  estimator*,  and 
analyses  of  estimated  data.  The  person-hour*  cost  data  indicated  that  the  minimum  uiimher  ol  rater- 
should  lie  increased  to  2.>.  and  (hat  the  expert  estimate  method  seems  to  he  an  inexpensive  and  rapid 
method  of  obtaining  maintenance  manpower  data.  V  revised  user*  guide  (Technical  Report  \FHRI.- 
TR-79-80)  was  prepared  on  the  hasi*  of  the  sludv  result*.  (.10  page*) 


78  Sauer.  D.W.,  Deem.  R.N..  «.*  Askrcn.  \X  .1).  hxpert  estimate  method  ol  generating  maiuleiianee 
and  manpower  data  for  proposed  Air  Force  systems:  l  sers  guide.  AFIIRI.-TR-79-R0.  \R- 
A082  992.  H  right-Pattersou  AI  R.  Oil:  Advanced  Svstems  Division.  March  1980.  Project 
I  12  f.  (.outraet  F8861.>-77-(.-00(>0.  Systems  Research  l.ahoratories.  Incorporated.  \  I  IS.  I  lie 
objective  ol  this  ellort  wa*  to  revise  a  prolotvpe  user*  guide  for  collecting  expert  estimate*  ol 
maintenance,  manpower,  and  training  data  for  new  or  proposed  \ir  Force  *v*tcm*.  The  revi-ion  of 
the  User*  guide  wa*  liascll  on  three  separate  ellort-:  a  review  ol  recent  expert  c-timalc  -Indies,  an 
application  ol  the  expert  estimate  method  u-ing  tin-  prolotvpe  u*er*  guide,  and  an  intlepemhutl 
evaluation  ol  the  guide  by  experienced  manpower  professional*.  \  revi-ed  user*  guide  vva- 
p  rod  need.  It  contains  the  procedure*  lor  tt-ing  the  expert  estimate  method  to  collect  maintenance, 
manpower,  and  training  data  lor  new  \ i r  force  -v-lem-.  It  al-o  eonlaiti-  examples  of  engineering 
description  package*  and  tpieslionnaire*  a*  well  a-  co-l  data  associated  with  the  expert  e-limate 
md  I  mil.  (2(>  page*) 


i  9  ItiK'klaud.  (..II..  Monroe.  K.G..  A  Melirer.  k.l.  Flight  simulator  runwav  v  isual  textural  cues  for 
lauding.  AHIRL- I  R-79-81.  AD-A089  181.  Williams  \FR.  AZ:  Operations  Training  Division. 
August  1980.  Project  1128.  N  I  IS.  I  lie  cited*  id  -even  dillcrctil  runwav  Ivpe*  were  investigated 
on  pilot  performance  during  landing-  in  a  T-87  flight  -imulator.  Data  were  also  gathered  on  (>  of  the 
-ante  12  pilot*  during  actual  T-87  aircraft  landing-  at  the  V i r  Force  Might  Te-t  ('.enter,  at  F.dvvard- 
M  15.  I  lie  -even  -i  titillated  runway  *  consi-tcd  of  one  night  runwav  and  six  (lav  runwav  *  with  varv  ing 
amounts  ol  textural  information  cue-  on  the  runwav  touchdown  /one  area.  The  night  runwav  wa* 
also  lc-ied  with  and  without  touchdown  /one  landing  light-  (TD-Zonc  light*),  and  the  dav  runwav* 
were  le-led  with  and  without  the  runway  overrun*.  The  -miniated  aircraft  average  vertical  velocitv 
at  touchdown  decrea-ed  *y -lenialicallv  from  201  It/min  for  the  night  runwav  without  the  TD-Zotte 
light*  to  1 8(i  1 1 /in  in  lor  the  day  runwav  with  I -foot  texture  pattern*.  The  dav  runwav .«  alone,  wit  lion  I 
the  overrun,  varied  I  rout  19,7  ll/min  for  the  Bare  Rones  runwav  to  1 8(»  fl/min  for  the  l- fool  texture 
pattern.  Vllhnugh  these  average  vertical  velocities  were  still  much  higher  than  those  recorded  in  the 
actual  aircrall  (12  It/min).  the  texture  pattern*  did  influence  the  pilot  flare  and  touchdown  in  a 
*y  -Ic ma lie  manner,  \ddit ional  visual  cue*  might  have  reduced  the  vertical  velocities  even  more,  hut 
the  limited  edge  eapacilv  ol  the  (  omputer  Image  Generation  (( IK 7 )  scene  did  not  permit  the  sludv  of 
other  visual  cue*  while  investigating  texture  patterns.  The  presence  of  the  TD-Zonc  light*  in  the 
night  -cone  also  reduced  tile  average  vertical  velocitv  at  touchdown  ( 1 90  It/min).  hut  I  hi- difference 
wa*  not  statistically  significant.  The  presence  of  the  runwav  overrun*  on  the  dav  time  runwav - 
limited  the  overall  range  ol  touchdown  vertical  velocities  to  a  smaller  range  spanning  from  I  7(>  ft/ 
min  lor  the  "W  illie  runwav  to  l  >8  ll/min  lor  the  f-loot  textured  runwav.  \\  hen  the  overrun  wa- 
present,  apparently  the  pilot*  used  the  overrun  v  isual  cues,  the  chevron  texture  patterns  and  other 
related  cues,  in  addition  to  the  runwav  texture  patterns  in  order  to  perform  the  flare  and  totiehdow it. 
riti-  rc*llllc<l  in  reduced  overall  touchdown  vertical  velocities,  hut  apparentlv  the  more  uniform 
pilot  performance  (restricted  range)  did  not  involve  an  optimum  use  of  the  1-loot  texture  patterns. 
Several  other  data  parameter'  also  varied  across  runwav  Ivpe*:  however,  there  were  no  consistent 
differences  related  to  runway  texture  patterns.  The  significant  effects  with  the  other  data 
parameters  were  most  often  related  to  differences  between  the  night  and  the  dav  runwav  scene*.  (.’>0 
pages) 


81 


80  Gustafson,  D.E.,  Mehra,  R.K.,  Ledsham,  W.H.,  St  Sajan,  S.  Recursive  forecasting  system  for 
person-job  match,  AFHRL-TR-79-83,  AD-A090  499.  Brooks  AFB,  TX:  Manpower  and 
Personnel  Division,  September  1980.  Project  2077,  Contract  F33615-78-C-0050,  Scientific 
Systems,  Incorporated.  NT1S.  The  overall  objective  of  this  research  effort  was  to  investigate  the 
applicability  of  time  series  analysis,  state  space  modeling,  and  forecasting  techniques  to  prediction 
of  Person-Job  Match  (PJM)  time  series.  This  work  was  undertaken  in  order  to  provide  more  accurate 
input  data  for  PJM  and  thereby  yield  higher  payoffs  to  the  Air  Force. 

The  approach  taken  was  based  on  several  new  results  in  time  series  analysis  and  forecasting  which 
allow  one  to  automatically  determine  multivariate  state  space  models  empirically  from  input-output 
data.  The  state  space  approach  is  an  extension  of  the  Box-Jenkins  method  and  gives  superior  results 
for  multivariate  time  series.  The  form  of  the  models  is  a  Kalman  filter/predictor.  Once  a  model  has 
been  determined,  predictions  can  be  made  based  on  this  model  and  past  data.  Since  the  underlying 
dynamics  of  the  time  series  may  change  in  an  unpredictable  manner,  provision  has  been  made  to 
estimate  the  parameters  of  the  model  recursively.  This  allows  one.  for  example,  to  follow  the  effects 
of  policy  changes  (fast  rate  of  change  of  parameters)  or  more  long-term  changes  which  cannot  be 
explicitly  modeled. 

The  technical  effort  was  divided  into  three  major  phases: 

Phase  I:  PJM  payoff  matrix  column  mean  data  over  a  five-year  period,  beginning  in  January  1973. 
were  collected  and  statistically  analyzed.  A  total  of  50  categories  were  selected  to  span  the 
dimensions  of  sex.  skill  score  and  job  area  (Administrative.  Electronic.  General  and  Mechanical).  A 
frequency  analysis  showed  that  various  series  contained  significantly  different  spectra,  with  peaks 
at  6/year,  4/year,  and  3/year.  The  semiannual  component  is  probably  tied  to  the  academic  vear.  A 
correlation  analysis  showed  that  most  female  high  skill  series  move  together.  Female  low  skill  series 
also  showed  the  same  trend,  though  not  as  marked.  Male  series  were,  in  general,  correlated,  but  were 
less  so  than  the  female  series.  Male  and  female  series  were  essentially  uncorrelated.  A  set  of  state 
space  models  was  developed  for  the  individual  t i m . -  series.  A  set  of  Kalman  filter/predictors  was 
then  generated,  based  on  the  state  spare  models. 

Phase  II:  An  adaptive  Kalman  filter  methodology  was  developed  for  the  PJM  data.  The  adaptive 
filter  was  an  approximate  maximum  likelihood  estimator  for  the  Kalman  filter/predictor 
parameters.  Two  adaptation  parameters  were  used:  (a)  an  age  weighting  parameter  to  discount  old 
data,  and  (b)  an  adaptation  time  constant  to  control  the  rate  of  change  of  the  parameter  estimates. 
The  adaptation  parameters  were  themselves  varied  recursively  to  minimize  the  mean-squared 
prediction  errors.  The  dynamic  coefficients  of  a  linear  Kalman  filter/predictor  were  estimated 
casually  from  the  data,  along  with  the  usual  Kalman  filter  state  estimates,  and  shown  to  give  better 
performance  than  the  non-adaptive  (stationary)  Kalman  filter/predictor. 

Phase  III:  An  extended  Kalman  filter  was  developed  for  use  on  the  PJM  data.  This  filter  was 
intended  for  use  in  estimating  toe  parameters  of  the  Kalman  filter:  i.e..  the  problem  studied  was 
that  studied  in  Phase  II.  The  extended  filter  did  not  appear  as  suitable  for  use  on  PJM  data  due  to: 
(a)  increased  complexity,  (b)  its  generally  poor  convergence  properties,  and  (e)  its  generally 
decreased  accuracy.  (314  pages) 
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HI  Danscrcau,  I). I'..  Holley,  (1.1).,  Collins,  K.W..  Brooks,  L.W..  McDonald.  B..  X  Larson.  I). 
V  alidity  of  learning  strategies/skills  training.  AFHRL-TH-79-8  f.  AD- A 085  650.  Lowry  AFB. 
CO:  Technical  Training  Division.  April  1080.  Project  1121.  Contract  MDA-OOH-TO-COilB. 
Texas  Christian  l  diversity.  NTLS.  Research  has  documented  that  most  students  lend  to  cuiplov 
inellicient  or  loss-than-oflcelive  methods  lor  acquiring.  retaining,  retrieving,  or  applving 
information.  To  acquire,  retain,  and  appropriated  applv  knowledge.  it  ha-  heeome  .•video!  that 
methods  designed  to  organize  inlorination  lor  presentation  to  learners  are  of  beneficial.  \  et  limited, 
effecliv cness.  In  contrast,  strategies  which  the  learner  find-  useful  in  transforming  information 
through  personal  ellorl  are  liked  to  he  "owned.  retained,  and  contribute  to  increased 
performance.  Programmatic  research  was  initialed  to  (a)  identilv  and  compare  the  effectiveness  of 
alternative  learning  strategies  upon  learner  performance.  (Id  incorporate  effective  strategies  and 
interactive  practice  materials  within  a  -V'lemalie  training  program,  and  (e)  etnpirieald  validate  the 
performance  id  strategics-trained  and  untrained  student-.  Some  of  the  strategies  included  have  been 
(a)  various  mnemonic  devices.  (Id  imagerv  elaboration,  (e)  paraphrasing,  (d)  visual  networking,  (el 
goal-selling.  (!)  distraction  desensitizalion.  and  (g)  formal  peer  interaction. 

Strategic— trailed  -indent-  achieved  I  , ‘V  to  |lt"n  more  on  technical  subject-matter  achievement  lo-l- 
I  ban  did  nut  >.nued  students.  Low  reading  apt  it  tide  -Indent  -  aeliiev  ed  more  under  imagerv  -Irategie- 
tlian  low  reading  aptitude  eoiilrol-  under  the  paraphrasing  or  the  uillraiuetl  strategies  condition. 
\  i-ual  networking  -Iralegie-  -Indent-  -eored  l2< >"■  ■  higher  on  delaved  retention  aeliiev etitenl  le-l- 
ilian  control-  in  the  untrained  group.  In  ino-t  ease-,  high  reatling  aptitude  -Indent-  achieved  more 
than  lower  reading  aptitude-student-.  I < >( >  page-) 
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task  analysis:  10.  28.  20.  II.  |7>.  10.  7)0.  .78.  70.  72 
task  analysis  handbook:  II 
task  aptitude:  70 


task  complexity:  17 
task  delay  tolerance:  8 
task  diagrams:  I7> 
task  difficulty:  8.  70.  77.  78 
task  factor  ratings:  8 
task  factors:  8 
task  identification:  7)0 
task  identification  matrix:  7)0 
task  proficiency:  00 
team  effeeliveness:  70 
technical  achievements  KY78:  20 
technical  data:  10.  .70 
technical  manual  development:  20 
j  technical  manuals:  28 

1  technical  training  :  0.  12.  20.  2d.  dO.  II.  f  t. 
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test  and  evaluation  methodology  :  dO 
test  taking  skills  training:  12 
texture  shading:  2 
textured  terrain  simulation:  27 
.  textured  visual  images:  2 
time  management  skill  training:  I  I.  20 
time  series  analysis:  80 
traffic  safety  :  5 
training:  1 .  2d.  28.  7 1 
training  cost  model:  Id 
training  course  design:  8 
training  devices:  2d.  d8.  77) 
training  effectiveness:  27).  7)1.  7)7) 
training  features:  7)2.  02 
training  management:  00 
training  priority :  8 
training  priority  index:  8 
training  program  evaluation:  00 
training  requirements  analysis  model:  Od 
training  simulators:  10.  d8 
training  systems:  08.  7d 
training  techniques:  10 
training  time:  77.  78 
transferability  of  skills:  I 
transfer  of  training:  27).  dO.  7>l.  7)7).  71 
troubleshooting:  Id 
troubleshooting  difficulty:  77.  78 


update  rate:  dl 
user  analysis:  .70 
utility  function:  dll 
utilization:  I 
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validity :  7  1 

verification:  !•*) 

visual  cues:  7*) 

visual  displays:  17.  7)7).  7') 

visual  networks:  81 

visual  simulation:  25.  27.  55.  71.  7*> 

visual  texture  pattern:  7‘> 


weapon  system  acquisition:  28.  2*1 

weapon  system  maintenance:  65.  66.  6 

weapon  svslcuis:  I 

weapons  deliverv :  7 

work  altitude  invenlorv  :  l(> 

wi»rk  environment:  16 

workload:  17 
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